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ABSTRACT 

This report discusses the analysis of prograa review 
data obtained through visits to schools identified by an earlier 
statewide cost^^ef f ectiveness study. Priaary purpose of this repoift 
was to detemine the feasibility of conducting program^ site reviews 
of selected schools for the purpose of recoanending instructional 
iaprovements. Site reviews were conducted at eight Floridqi schools 
selected froa aaong the 50 aost efficient and 50 least efficient 
schools as identified through analysis of Florida's 1974 Statewide 
Assessment Test of basic skills* In their site reviews, visitation 
teams concentrated on five areas: staff development, planning and 
program evaluation, curriculum, v management, and program support 
services. Results of the program site reviews suggested that (1) the 
concept of such vistations was feasible, but (2) the survey 
instruments would have to be greatly improved, and (3) the areas 
under investigation were too broad* The appeadiz contains a copy of 
the program site review instrument, as well as several tables that 
summarize the observational data gathered through the site reviews* 
(JG) 



* Dpcuments acquired by ERIC include many informal unpublished * 

* materials not available from other sources* ERIC makes every effort * 

* to obtain the best copy available* Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and Ldrdcopy reproductions ERIC makes available * 

* via the ERIC Document Reproduction Service (EDRS) * EDRS is not * 

* responsible for the quality of the original document* Reproductions * 

* supplied by EDRS are the best that can be made from the original* * 



EKLC 



ERIC 



INDiCATOKS OF EFFECTIVENESS AND EFFICIENCY 

PART III 

A Report of Program Site Reviews 
of K-3 Programs at Selected Schools, 1974-75 



State o 
Department 
Ralph D. Turling 



f Florida 

of Education 
ton , Commiss ioner 



3 

o 

ERIC 



FOREWORD 



This publication is one of three reports anticipated 
from the management information generated by the Floiida 
Department of Education cost-effectiveness effort • The 
purpose of these three reports is explained below. 

I. Part I is a position paper on the Cost-Effective- 
ness System and reports the data on cost effectiveness 
produced by the system. (See Indicators of Effectiveness 
and Efficiency , Part I_,_Series 76-070 This report ranks 
1,146 schools with K-3 programs from the least effective 
to the most effective based on the 1974 Statewide Assess- 
ment Test of basic skills, . 

II. Pait II will be a statistical analysis of the data 
in Part I and" information currently available to i;he Depart- 
ment of Education, such as size of school, pupil -teacher 
ratio, etc., . . which might relate to cost-effectiveness 
information. (This will be published soon and should com- 
plement the on-site visits explained in Part III,) 

III. Part HI is an analysis prepared from information 
obtained from on-site visits to schools that cire at the 
extremes of the ranking report. These program site reviews 
were made by program consultants and other education pro- 
fessionals. This publication contains the results of 
these program site reviews. 
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Because the influences which affect student achieve- 
ment are sub tie , complex and interrel^P^d , it is essential 
that instructional professionals be involved in the-cost- 
effectiveness process. Quantitative measures of school 
performance should be tempered by professional judgment. 
Professional involvement as needed if we are to under- 
stand the process of education, and their involvement will 
facilitate aaoption of successful practices when identified. 
The background, procedures, results and conclusions of 
this involvement are explained in this report. 

The follow-up study was a joint effort of the various 
bureaus within the Departments^ The project was coordinated 
by the Task Force on Cost -Effect iveness Study and Assess- 
ment Follow-up, chaired by Dr. J. W. Crenshaw. 
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I. INTRODUCTION 



Background 

In the I'ate 1960's, legislators in several of the 
individual states became interested in educational account- 
ability. While there were differences in approach to the 
topic, generally, the developing accountability efforts 
sought to (1) define what the schools should be accomplish- 
ing, and (2) determine if the stated' goals are being accom- 
plished. 

In Florida, the Legislature initiated the ^Educational 
Accountability Act of 1971 v/hich authorized establishment of 
statewide learner objectives, a statewide assessment program 
and certain public reports of results. Additionally, the 
Statute provided for ^'accurate analysis of the costs asso- 
ciated with public education programs; and • • .an analysis 
of the differential effectiveness on instructional programs. 
Thus, the Florida legislation went a step beyond the pattern 

established in other states by requiring that an attempt be 

I 

made to determine effectiveness as related to costs. 

The Department of F:ducation responded to these legisla- 
tive mandates by implementing cost reporting procedures and 
educational assessment measures. The project described m 
this report was an attempt to continue this developmental 
effort leading toward a comprehensive cost effect iveness 
analysis system. 



'Chapter 70-, "^99, Laws of Florida 



Statement of Problem 

The purpose of this project was to determine the \ 
feasibility of conducting program site reviews' of selected 
schools for the purpose of making recommendations for in- 
structional improvements. 

Reasons for Making the Study > - -As mentioned previously., 
the Department of Education was mandated by the Educational 
Accountability Act of 1971 to implement cost-effectiveness 
studies. This legislative interest w^s reinforced in 1976 
when several related statutes were combined into the 1976 
Educational Accountability Act (Section 229.55, Florida 
Statutes) . 

The interest of the Legislature is no doubt, related 
to the rising costs of public education and the dearth of 

information about the relative effectiveness of various 

/ 

programs. 

The Department of Education needed to conduct the 
present study in order to determine whether or not on-site ' 
visitations of certain schools could identify components 
of effective programs. If successful ^ Department reviewers 
could begin a program of on-site visitations to schools con- 
sidered least cost effective in order to recommend programmati 
charges. Likewise, effective school programs coulid be 

s 

more accurately described and diffused statewide. 
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Development of Cost -Ef f ect iveness Pro j eCt > - -The present 
project developed from two related operations of the 
Department: the Statewide Assessment Program and the cost- 
effectiveness and efficiency study project of the District 
Planning Section, Division of Public Schools. 

The Assessment Prpgram, created in -1971, collects 
information yearly on the basic skills achievement of 
florida public school students* At; the. time the cost- 
effectiveness studies were being initiated, assessments 
were conducted in grades .three , six, and nine.; however, 
-this has since been changed to grades three, five, eight and 
eleven. ^ / 

As one of its reporting strategies, the Assessment 
Program implemented a ''predicted" scoring system. | 
Simply stated, this system adjusts each school's average 
score so that it reflects the average score of other 
similar schools. Similar^ schools are those which are 
alike in terms of five sel^ected non-school factors. 

If a school's score is higher ths.n its adjoasted 
(predicted) score, the school is said to be performing 
better than expected, and vice versa . 

The Cost-effectiveness study builds upon the notion 
of the adjusted (predicted) assessment score, adds a cost 
factor, and produces a ranking of schools based upon 

9 
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ef f ect ivoness and efficiency. 

In April, 1976, after the first cost-effectiveness 
publication was released, a special Task Force on Cost- 
Effectiveness Study arid Assessment Follow-up was appointed 
within the Division of Public Schools. This Task Force was 
charged with various responsibilities which include'd: 

1, identification of, school variables (characteristics) 
to be analyzed and evaluated by .on-site .teams ; 

2. development of a process by which these program 
site reviews could take place; 

3. evaliiate these procedures for implementation of 
large-scale visitations in the fall, 1976; 

4, conduct program site reviews of a larger sampling 
of schools in 1976, analyze the data, and prepare 
a final report of the project. 

The Task Force proceeded to conduct program site re- 
views at eight schools during May 17-26, 1976. The schools 
were selected from the list of 30 most effective of the 
50 most efficient schools and from the 30 least effective 
of the 50 least efficient schools as identified by the 
Indicators of F.i'f ect iveness and Efficiency , Part Report. 

'visitation teams conducting program site reviews con- 
centrated on five areas: (1) Staff Development, (2) Planning 
and Program Evaluation, (3) Curriculum, (4) Management, and 
(5) Program Support Services, teams were provided survey 
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Florida Department cf Education , Indicators of Effec - 
tiveness and Efficiency , Part ^ I , 1976. 
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instruments in these five areas produced by Departmert staff. 

The results of the program site reviews suggested three 
problems: (1) the concept of such visitations was feasible, but 
(2) the survey instruments would have o be greatly improved, 
and (3) the areas under investigation were too broad. While 
the first of these two problems could be easily solved, the 
latter could not. The Task Force spent considerable time 
attempting to determine whether or not the research literature 
consistently ij;pecified certain factors to be highly related to 
school achievement, effectiveness, or efficiency (in a cost 
sense). Unfortunately, previous research did not provide a 
simple answer. Apparently, there are many variables which 
appear to be related to achievement under selected study con- 
ditions. Since the number of potentjial variables is quite 
endless, it is difficult to select any given set as being 
the only ones worth consideration. 

Therefore, the Task Force ook the approach that future 
program si to reviews would not attempt to determine, in a 
definitive way, which variables conclusively affect cost- 
effectiveness and efficiency. This would take many more 
resources than were available. Alternatively, the Task 
^ Force would attempt to build into its fall, 1976, program 
site reviews the best of v;hat was known about school effective- 
ness variables and assume their validity for purposes of this 
study. This report documents the Task Force's degree of 
success with this a[)proach. 
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Study Objectives/ 

This study proceeded with two general hypotheses: 

1. Procedures can be developed to conduct program 
site reviews of basic education programs. 

2. Program site reviews of selected schQ;3ls can re- 
veal real differences in quality of school programs 

These hypotheses will not be tested in a statistical 
sense but will be judged by the weight of evidence accumu- 
lated. 

/ 

There are several assumpt ions be ing made in this pro- 
ject. It is assumed that: , ; ^ 

1. The Statewide Assessment Program is an effective 
measure of school achievement ; 

a. the tests are valid and reliable; 

b. the objectives tested are valid; ^ 

It 

. c . the data on school level achievement is 
accurate; . - 

2. The adjusted or predicted test scores are adequate 
reflections of desirable output for given schools; . 

3. The definition of \a cost-effective and efficient 
school is adequate and defensible; 

4.. The Department staff serving as auditors are pro- 
fessionals capable of objective observations; and 

5. The department professional staff have correctly 
identified the most sajient variables for investi- 
gat i on . 
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Within the project there are also certain obvious 
limitations. These are: 

1. The project was limited in scope to the K-3 pro- 
. gram category . 

2. The project utilized only data generate^^by the 
1974-75 educational assessment. 

3. The project utilized data limited to reading, 
writing, and mathematics. 

4. The project visited only a very small sample of 
schools due Xo limited resources of time and man- 
power. Conclusions should be extended beyond the 
sample only with great caution.- 

. This report is an analysis of the procedures of, and 
ihc conclusions from the program site reviews conducted to 
meet the purj^oses enumerated a|30ve. The next chapter expla 
the me t hodo 1 o}.;v and instrumentation used in this process. 
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II. PROCEDURES OF THE STUDY 



General Methodology 

The overall objectives of the visitation program were 
to identify and look for evidence of in-school variables 
which make a significant difference in the learning environ- 
ment and can be observed only on site. 

In accord with direction contained in a memorandum 
(see Appendix I), from the Director of the Division of Public 

Schools, the members of the Task Force identified the specific 

1 

tasks to be accomplished. 

A first step was to undertake a preliminary operation 
in which pertinent additional data, significant differences 
in schools, and other observable in-school variables were 
identified; a process and a strategy we re deve loped , and a 
pilot project involving a limited number of selected schools 
was conducted. 

The original pilot study was accomplished within the 
limited time allowed. May 10 - May 16, with as much advance 
planning as could be accomplished between April 26, 1970, the 
date of the original assignment, and the first visit on 
May 10, 1976. The tight time schedule was necessitated by the 
impending close of the school year. 

After a careful evaluation of the. process and analysis 
of the data obtained from the pilot study, a revised and 



improved strategy was developed for subsequent visits to a 
larger sampling of outlier s chools ^(schools at the extremes 
of the rankings) . 

As an integral part of the strategy, the Task Force 
developed a time chart which listed all activities to be 
ac-complished and the dates for beginning and completing them 
(see Figure 1 ) • 
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The individuals or 
the specific tasks were 
quently accomplished in 



agencies responsible for accompli shing 
then designated. Each task was subse- 
accord with a plan approved in advance 
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by the Task Force, 

Actual visitation was undertaken by 10 teams, each 
comprising three professional staff members, chosen insofar as 
practicable for their expertise in the area to be observed. 
An orientation class for team captains was held, and each 
captain was given responsibility for fully briefing each member 
of his team. Team captains were also involved as reactors in 
the process of developing the observation instrument. 

Five discrete areas Curriculum, vStaff Development, 
Management, Support Services, and Planning and Program 
Evaluation were designated for observation. Specialists 
in these areas were assigned to observe in their areas oi 
specialization to the extent practicable. Teams spent one to 
two days in each school. 

Particular attention was given to the full study on 
"Indicators of Effectiveness and Efficiency, K-3 Programs.** 
The three steps, as reflected in Part I of the study, were 
reviewed along with the data in ^^rt I. 

A close relationship was mal.vcained with the developers 
of Part II to ensure that the data and characteristics of 
schools reflected in this part were well known/ to the dcvelopei 
of Part III . 

Attentipn was focused directly on learni^ng environments 
and instructional techniques in the specific areas of language 



^The Foj-eword of this report explains the three reports. 
Part I, Part II and Part III and their relationship. 
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conimunicat ion and mathematics because the selection of 
schools to be visited was based on the published results of 
the 1974- 7."^) assessment in these areas and the subsequent 
cos t- effectiveness study which utilized tlie assessnient data. 
It should be further noted that the actual program site 
reviews took place in the fall of 1976. 

In st rumentation 

The instruments utilized in this study went through 
several phases of deve lopnient . Initially, Departiiient pcM'son 
ncl in the various program areas developed a comprehensive 
list of items pertaining to the operational areas of public 
schools; This list was reviewed, edited, and revised to 
'i^llminate I'cdundant items, c 1 ar i fy i n ten t , and reduce inter- 
viewer burden while still providing an adequate rating sheet 
to h^termi.iic the absence or level of obsei'vecl [M-esence of 
rtiose factA')rs considered essential to the ()[HM*ation o f "a Vt 
oduca. r i una I. program. 1-ollowing a final rcvMAns' hy tlu* Taslv 
l-orce, the* L ns t ruments^, were i:)rinted with items {grouped by 
])iO«j,rain area and accompanied by a status sheet' of dcMnog ra[^h i c 
Jata about the school. The- complete instrument is provided 
i n A[)]K-^ndi x 1 F . 

The final instrument, which was given to departmental 
personnel to assess in-school characteristics, C(^nsislec] of 
five general sections: CurricuTum, Planning and Program 
Hvaluation, Staff Development, Manageinent , and Support S(.'rvicr' 

17 



-12- 



Except for Support Services, which was composed of three 
subsections representing the basic support services available 
to all schools (Library and Media Services, Student Services, 
and Health Services), each section contained several selected 
broad questions (items) representing trends, concerns, theories, 
and assumptions currently believed to be essential to a quality 
education in that area. 

Each item on the instrument represents a single, broad 
concept with several aspects and with several perspectives 
from which its quality, uniformity, degree of development, and 
pervasiveness may be judged. Qn the survey instrumer^t (see 
Appendix H) the "evidence" presented for each item represents 
those minimal perspectives by which a school was to be judged. 
All items were designed to be interlocking as was the support- 

ig evidence within items and between items. For example, 
item 1.2 under "Curriculum" is supported by evidence which 
states, "Cr i teri on- referenced evaluation was utilized." The 
notion of criterion- re ferenced test data is modified as to 
aspect and appears as item 1.3 under "Planning and Program 
Evaluation" with reference to overall school program planning. 

The nature of this study an^ of the survey instrument 
required the interviewer to use professional judgement based 
on observ^itions and conversations, etc., to determine a rating 
for each item. The use of both hard and soft data were permis- 
sible. The instrument provided the interviewer with a modified 
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five-point scale as follows: 

0 Item Gannot be rated (for any cause) 

1 School performance is not acceptable 

2 School performance is inadequate 

\ 3' School performance is satisfactory . - 

4 School perf ormarfcev is good \ 

5 School performance is exemplary. 

■ The choice of this scale represented a qompi^pmise 
between a more detailed 10 or 11 point scale, wherei^y the 
small gradations of quality would make it difficult to 
identify and define, and a three point scale , 'whjch would be 
able to distinguish little more than the presence or absence 
of a characteristic, v " 

No aspect of the instrument has been finalized. The 
nature of the statistical data obtained from the initial use. 
of the instrument and from the debriefing of Department 
personnel utilized as interviewers have indicated various 
{general and item specific inadequacies (see Table III). In 
addition, as modif icat ions are made and the instrument is 
refined, the need for further ciianges may become evident. 

. \ . 

Selection of the K- 5 Schools for Visitation 

The Department of Education decided to conduct^ the 
present study in order to ascertain the feasibility of program 
site reviews and whether or not such teviews could identify 
components f>f clfective programs. T'le ultimate goal i; the 
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recommend.at ion of programmatic changes where needed and 
more productive dissemination and diffusion efforts. For 
this reason, schools involved in the program site reviews 
have come from the upper or lower end of the effectiveness/ 
efficiency ranking. 

An effectiveness and efficiency ranking was done for 
Florida's 1,146 K-3 schools for which program costs and test 
results of the 1974 Statewide Assessment Test of basic skills 
were available. Hf fectiveness was determined by compariiTTg 
the actual score oT a school to a predicted score. This 
predicted score was calculated using information available 
in the Department of Education in the following areas: 

1. Minority status of students per school; 

2. College level of parents of students; 

3. Income level of parents; 

4. Number of students in families involved 
in ''whi tc collar" occupations ; and 

5. Percentage of Spanish students per grade. 
Efficiency was determined by comparing the effectiveness 

of programs in basic skills to the per student cost of programs. 

A statewide report-^ ranked schools by efficiency. These 
schools were listed from the most (upper end) to least (lower 
end) e f f icient An indicator of effectiveness index was also 

^Florida Department of Education, Indi cators oj^ 
E f f ect i veness a_n d^ W f f ic i ency , Part 1 , 1 9 7 () . 

20 



reported. To determine which 50 schools would be visited, 
tlie following steps were executed: 

1. Selection o£ Top 25 Schools to be Visited 

a. Determine 100 most efficient schools on ranking 
report. 

b. From this 100, select most effecti^'-e (excluding 
schools visited on pilot project). 

2. Selection of Bottom 25 Schools, to be Visited 

a. Determine 100 least efficient schools on o 
ranking report . 

b. From this 100, select 25 least effective 
(excluding schools visited on pilot project). >. 

It was assumed that the top arid bottom schools should 

display a better picture of apparent differences than would 

a random sample. In addition, these two extremes wi]l continue 

to be of prime importance to the Department. For the lower 

end scliools the Department will wish to make^ programmati c 

recomjiieiula t ions , and the upper end schools should provide many 

successful instructional practices for dissemination and 

♦ ' ... 

diffusion. 

Schools which had a change in grade organizational 
structure between the date for which information for the rank- 
ings was gathered and the date of visitations were excluded 
from the select ion procedure . Had this not been clone, the 
visiting te:in,s would not have had like samples nor would they 
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have seen similar composition as existed when the rankings 
were cfbne • 

The Methodology, Instrumentation, and the Selection of 
Schools have now been explained. The next section discusses 
the Analysis Procedures. 

Analys is Procedures 

The 50 schools in the cost efficiency/effectiveness 
follow-up study provided 49 sets of data suitable for statisti- 
cal ' analys is . These sets of data, each consisting of 41 
discrete items,- were divided into two "groups according to" the 
relative efficiency/effectiveness of the schools they repre- 
sented: 25 into the most efficient/effective group; 24 into 
the least ef fi ci'^nt/ef fective group. The remaining set of data 
represented a school which inadvertently fell into neither 
group and therefore was not suitable for* comparative -analysis . 

Three statistical analyses were performed. In each, the 
basic pattern was to compare the most efficient/effective 
schools with the least ef f icienf/ef f ective schools. The analyses 
performed were as follows: 

1. a frequency count for each item for all schools . 
within each group; 

2. computation of mean scores for each item for 
ail schools within each group; 

3. analysis of variance. 
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Item Frequency Analysis In each group. a frequency count 
was performed for each of the 41 items. The survey instrument 
was designed to provide for six possible observed ratings of 
a number of related characteristics constituting an item. The 
designed ratings ranged from "5" denoting an exemplary practice 
to ''1" denotin., a very substandard practice. ''0" denoted the 
item could not be rated. Two additional designations were \ 
added: "NA" meaning no rating was available although the 
observer had made comments and "M" meaning the observer made 
no rating and had provided no comments. 

I tem. Mean Score . --In each group the mean score was computed j 
for each itc-m for all schools. Only ratings of '^1/' "2," '*3," 
"4," and "5** were used in determining each mean. Designations 
of »^0," "NA/* and "M*' were not found to be suitable for 
numerical nnalysis; "0" by design meant that a cliaracter i s t ic 
could not he rated without regard to the- reason. ">]A** and '*Nr' 
were addition^il designations adopted to explain the causes of 
ratings which otherwise would have been assigned "O's/' 

Analysis of Variance . - -To determine whether there were 
signi f leant di fferences in the mean scores for each item 
between tli^ two groups of schools (most efficient/effective vs. 
least efficient/effective) a simple analysis of variance (ANOVA) 
was employed. The level of significance (cx: value) was deter- 
mined by subjecting ANOVA value to a one-tailed Fisher t-test. 
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This process was repeated for each of the 41 pairs of items 

in the survey instrument. In this type of analysis the level 

of significance expresses the probability that the differences 

♦ 

calculated occurred by chance. By statistical convention .05 
or (1 chance in 20) is accepted as the highest value of od 
which can be significant. Values greater than . 05 mean . that 
the phei>onienon^ occurs too often by chance for the data to be 
trusted. Other Orvalues and their meaning are as. follows: 

• 01 ""^^ - 1 chance in 100 that the finding, occurred 

/^^^ • by chance; 

/ 
) 

.005 - 5 chances in 1000 \h per 100) t^J^^t the 
finding occurred by chance; 

.001 - 1 chance in 1000 that the finding occurred 
by chance; and , . 

.0005 - 5 chances in 10,000 that the finding • 
occurred by chanCe . 

The next chapter explains the results of utilizing these 

procedures . 
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Til. PRESENTATION OF RESULTS 



Results of the Observations 

The methods of statistical analysis of data used in 
this study were designed to (1) look for the presence of > 
significant differences between the most efficient /ef fee - 
tive schools and the least efficient/effective schools for 
any two selected matched pairs of scores, (2) identify, weak- 
nesses in any questions in the survey instrument, and 
(3) formulate reconmendat ions and conclusions. 

Each of the? three statistical procedures previously de- 
scribed provided meaningful informat ion in the determination 
of differences between the two groups of schools. The reader 
may refer to Appendix III for^a compjete item analysis of the 
data for each group of schools. 

It em Frequency Analysis -For each i-tem a comparison of the 
ratings given to schools in each group revealed the most 
efficient/effective group rece ived more "5** and "4*' ratings 
than the least ef f ic ient /ef f ec t i ve group on ,37 or 41 items 
(see Table 1). On only 4 items did both groups receive the 
same number of *'high" scores, it was not a matter tlie 
least efficient/effective schools scoring more strongly, 
but the opposite. The most efficient/effective schools 
scored weakly on the item. The converse of tllis situation 
was not as decisive. The most ef f ic ient /effect ive schools 
received fewer "low'* scores, i.e., ratings of **1" and 
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TABLE 1 

ITEM FREQUKNCY ANALYSIS: HIGH , RATINGS 



Survt-y 
Item Number 



Descript ion * 



Number of High Ratings ("5" and "A") Awarded 



Most 

Efficient /Effective 
Schools 



Least 

Efficient /Effective 
Schools 



CURRICULUM 



1.1 


Grouping 


1.2 


Instr Prog 


1.3 


Diagnosed Needs 


1.4 


Red of* Std Prog 


1.5 


Balanced K-3 


1.6 


Self Concepts 


1.7 


Lrng Environ 


1.8 


Variety of Mats 


1.9 


Mult.-Cult 


1.10 


Home -Sell Commun 


1.11 • 


Parent Educ 


'1.12 


K-3 Coord 


i'UVNN^G AND PROG. :j-VAL. 


1.1 


I' Ian ning 


1.2 


N-R Trst Data 


1.3 


C-R T*.'MC Data 


l.A 


Non-Achiev. Data 


STiMT DEVELUPMEN! 


1.1 


Mot Noods 


1.2 


^\pply Ski lis 


MANAGLMKN I 




1.1 


Kos[)uiiN ib il icy 


1.2 


iU>r>pt:ct 


1.3 . 


PiJn is hm».*nf 


l.A 


I'ollci.'S 




P rlnc ip.i 1 


1 .6 


AdiMiuaLe Kes 


J. 7 


Records 


SUrPORT SERVICES 


Library 


-«nil Midi. I 


T.T 


Si mult AcLiv 


1.2 


A c «; s i> 


I. J 


! nput 


l.A 


Mate r i.il s 


1.5 


Media Activ 


1.6 


t\-\l Equip 


1.7 


Tech ^\ssi6t 


Student 


Services 


2.1 


Coor Program 


2 . 2 


Refrl ^ Flw-up 


2.3 


Clsrm Mgmt 


2./. 


Staffing 


2.5 


Counsel in 


2.6 


Care<*r Aware 


lloalLh 


Service's 


f 3. r 


Scrffti ill/. 


3.2 


(Ions 11 1 1 


3.3 


Phy Si NiiLr A^jscss 


NOTFlS : 



14 
13 
12 
13 
12 

13 

14 . 
7 

(14) 
5 
11 



10 

9 
11 
9 



14 
15 



19 
20 
20 
20 
20 
14 
17 



( 6) 
12 
iO 
14 
10 
.13 
7 

10 
( 3) 
7 

11 
7 
9 

13 
8 
6 



2 
2 
4 
6 
7 

(11)^ 
11 
1 
3 

(14) 



10 
15 
14 
10 
11 
9 
IJ 



( 6) 
9 
3 
7 
8 
3 
5 

4 

( 3) 
3 
4 
4 
4 

() 
b 
3 



Words tind nbbrcvi.it. ion*; listed under "description" and opposite itfm luimher.M provide 
a key to the font in i of t he i tern . Append ix f I gives an t xac t descr i pt ion of each J t em . 

^Figures end os»i! in parentheses () denote data for it»m.s on which both groups of 
schools rert^ived equal numbers of "high" ratings. 
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*'2'* on only 32 of 41 items (see Table 2). On six items 
the two groups received the same number of low scores and 
on three others^ the least efficient/effective schools re- 
ceived fewer ratings of ''1'' or ''2'' than the most efficient/ 
effective schools . 

Interestingly, th,e explanation for the aggregate num- 
bers of low scores (**1** and *'2") between the two groups of 
schools in these six instances 'tends to be the opposite of 
that for high scores (*'5'' and '*4") , In only two instances 
was the damping or juxtaposition of scores of the two groups 
caused by the most efficient/effective schools scoring 
weakly; while in the five other instances, the least effi- 
cient/effective scored very strongly. The inconsistency in 
scores attained by the most efficient/effective schools is 
highlighted by the fact that on five items the group re- 
ceived no low scores. The least efficient/effective group 
had at least one low score on all 41 items. 

Item Mean Scores .- -A comparison of the mean scores or ratings 
for each item for all schools within the two groups revealed 
decisive differences , The most efficient/effective schools 
had a higher mean score than the least efficient/effective 
schools on 30 of the 41 items. On only one item having to 
do with health services (item 3,2) did the least effi- 
cient/effective schools have a higher mean score than the 
most efficient/effective schools. Figure 2 compares the 
mean scores for the two groups while Appendix II 1-3 pro- 
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TABLE 2 



ITKM FKEi^UKNCY ANALYSIS: LOW RATINGS 



Item Number 




Number of Low Ratings 


["2'* and "I") Awarded 


Description^ 


Most 

Efficient /Effective 
Schools 


Least 
Efficient/Effect Ive 
Schools 


CURRICULUM 




• 




1.1 


Grouping 


2 


5 


1.2 


Instr Prog 


3 


11 


1.3 


Olagnoseii Needs 


5 


11 


l.^ 


Red of Std Prog 


2 


10 


1.5 


Balanced K-3 


1 


5 


1.6 


Sel f Concepts 


1 


2 


1.7 


Lrng Environ 


2 


3 


1.8 . 


Variety of Mats 


2 


7 ' 


1.9 


Mult-Cult 


• ^ K 


11 . 


1.10 


Horae-Sch Commun 




( 1) 


1.11 


Parent Educ 


(9) 


( 9) 


1.12 


K-3 Coord 


2' 


12 


PLANNIHC AND 


PROG. EVAL. 






"1.1 


Planning 


2 


■ 6 


1.2 


N-R Te .t Data 


1 


8- 


1.3 


C-R Test Data 


0 


5 


1.4 


Non-Achlov. Data 


2 


5 


STAFF developmj:nt 






la 


Mrt Needs 


2* 


1* 


1.2 


Apply Skills 


0 


2 


MANAGliMENT 








1.1 


RtiSpons lb LI Uy 


0 


2 


1.2 


Respect 


(1) 


( 1) 


1.3 


Pun i slmit-nt 


(1) 


( 1) 


1.4 


Pol Icics 


0 


2 


1,5 


Princ I pa I 


1 


5 


1.6 


Adequate Res 


2 


6 ; 


1,7 


Records 


0 




SUPPORT SERVICKS 




\ 


Library and_ Medla^ 






1.1 


Sirault Act Iv 




1.2 


Access 


2 


.4 


1,3 


Input 


1 


2 


1,4 


Materials 


1 


4 


-1,5 


M(iiiia Activ 


2 


3 


1,6 


A-V f'qulp 


1 


3 


1,7 


Tech Assist 


5 


10 


Student Services 






2.1 


Coor Program 


2 


9 . 


2,2 


Rcfrl & Flw-up 


3 


7 


2,3 


Clsrra H\\mt 


3 


12 


2.4 


Staffing 


3 


5 , 


2.j5 


Counseling; 


4 


10 


2.6 


Career Aware s 


6 


7 


Health Services 






3,1 


Screening 


3* 




3.2 


Consul t 


5* 




3.3 


Phy & Nutr Assess 


(4) 


( 4) 



NOTES: 

.^ords and abbreviations listed under "description" and oposite items numbers provide 
a key to the content of the item. Appendix IT gives an exact description of each 
item. 

^Figures enclosed In parentheses () denote data for items On which both groups of 
schools rect^ived equ.il numbers of "low'* ratings. Figures 'marked with an asterisk * 
denote items for which the least efficient/effective schools received fewer, numbers ^ 
of "low" r.itlngs. 



FlCmV. 2 - MKAN SCORKS 



MOST EFFICIENT/EFFECnVK SCHOOLS 

vs 

I.KAST EFFICIKNV/F.FFFCTIVI- SCHiUl S 



1 1 Nunih vrr 



ript Ion 



Mi'iin Scores 

(Most Eff icli'nt/Kf fiH-t ivc Schools - solid lino) 
(Least Ef f Iclent/Lf fccUvc Schools - brokt-n U;k) 



(:i'i;uu:i'L(r^ 

1 . 1 ^roujdn^ 

1..' I nst r»Ji- 1 lonal Program 

1 , '■ Rfcorii ot Sludejit Progress ■ 
' . M.ilHiufil K-3 I'inj;r.im 

].'■ Sflf-r.Hv . nf 

' . " l.t .W .t I .I'.' 1 : tiiT-n t 

■■ . '' \'.M \* \ ■ t.r .-r i .1 1 s 

' . '■ -i i I 1 -Ctt ! I 111 it I'rt>v;r.im 

Iltiint" - Sr'mol Ct^mniiii i caf lOn 

'.II P.iri-nt Wli.c I' icMi 

1.1!' K-l^l'n-^ram i i M^ril i na r i on 
t'LANNIN'j^ ANH PR('X_[RAM TVAM A 1 K^N 

i . 1 Plann Iti^ 

].2 . N'orra-Ht« Uti-u. A (t Ti-sr DaJa 

i 

1.1 Crlter 1 .Mi-Pi I L*ri-nrt»cl Tvist Data (A 
I. .Si Non-Ac h ievi-rxini- lost Pat.i 
STAFF DEVELOPMENT 
I . ; Program Mi t N«.'i>d>, 

1.2 Teachers Apply Skills 

^tA*SACgM^:NT 

1 . 1 Rcspnns ih i 1 i ty 

1.2 • Rf3pi?ct 
1.1 Punishntnr 

1.4 PoUcifH 

1.5 Principal 

1.6 Adequate Resources 

1.7 Records 




Sir,»> I leant 


n i 1 I 


I roiici- 


1 

i Significant 


lUl t 


•t once 


; SlKnlfiianl. 


Di I I 




1 

S Ignl f [ I anr. 


Dili 


«.'ri'tu:e 


,S ign I f leant 






> S lyn i t leant 


IM f t 





Significant Ui f f i?rtMuo 



Slgnll hant 
Slgnlf 
Slgnlf leant 
SiRni f t cniu 



[) i fforcnct' 
i){ I f cri/ni'f 
Dlt feronct' 
Ulf ffrt-ncc 



Significant D.fft'rence 



Significant Difference 



j Significant 
{ Slgniflranc 



Di f 1 erence 
Difference 



Significant ntffurence 



NOTES: 

^Kords and abbrevl/itlona listed under "description" and opposite Item jipmbers provide a key to the 
content of the iten. Appendix III provides an exict description of each Item, 
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KI'UIRK >-r,int inn,'. J 



Tun Ni. ih.-i 



l)r r i j> t i ,in 



S li f TOH'I S V u : E s 

I.H»r irv •I'ul Mrdi.i Si-rvi. 



! , ) 

1 . \ 
\ J 
1 . ') 
i ,^ 
1 . 

: . 1 



S ! nu 1 1 M.-. \. t I V i ( i .-s 
A.- CIV..', 
1 np'il 

M.tti^rlils 
* i.\ f i V i L i 
A-V K'lii i pn«'nt 
T i-rhii i c .1 1 Ash i ; ' .nu r 

r.uird I n.it . (I !'roi' r.'in 
R. ferr.il .nul KolKn.;-!:p 
(!l.nsri>iin M.m.iP.cnu nt 
St U I in^ 
C'Uinsel 1 inr. 
(7.«ri'CM Av.M r< «H s*. 
Mfiil th .%»*vli^*«s 
i. 1 An nun I Sc r«.-i-*ii i n^'. 

'J,;' Corsii 1 1 .'Lt i on^ 

"1. > t'hvKiL iil .in.i Nut. r i t Ion . 1 



1' . 



(Mi.>st Kf I ii: ii'iu /Ft t fci Ivi- Seht>.5U 
(Lea lit ' Kf t I r li iii M t ) iM l i vt- Schoo 1 s 



brnkc-n line) 





A 



Significant Dlfforcnce 



SlRnlf leant Oifforcncc 
Significant Difference 
Significant Difference 
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NOTES : 

''*word!* .niu .iNbiev 1 .i t i < )nn listed under "desc r l;'t Ion" and opposite item numbers ])rovldo a key to the 
content of the itt-n. Appendix m nrovidr-^ an 'ex."»ct description of each item. 
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vid3S complete data for each item. 

The survey instrument assigned specific meanings to 
the various ratings as follows: 

1 - not acceptable 

2 - inadequate (needs improvement) 

3 - satisfactory ' 

4 ' good (above average) 

5 - exemplary 

With this terminology in mind the most ef f icient/ef fec; 
tive schools were cumulatively rated as^ above average (mean 
item score 4*0 or better ) on only three items, all dealing 
with school management. This same group, however, received 
only one mean item rating below 3,0 (i,e., "needs improve- 
ment**) on an item related to parent education, a concept 
not well understood in 1974-75. By contrast, the least 
efficient/effective group receiv.ed no mean item scores of 
4.0 or better and accumulated 19 mean item scores less than 
3»0 (''needs improvement"). 

Analysis of Variance -The analysis of variance was the 
most revealing method used. Of the 4.1 pairs of mean scores 
on items compared between the two groups of schools, 20 were 
found to be statistically significant (see Appendix III-4). 
Each of the five major areas of concern on the survey in- 
strument contained one or more individual "tems shown to 
be. significant . The differences in the mean scores for all 
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items in the Planning and Program Evaluation Section were 
significant; in Curriculum 581 (7 survey items out of 12) 
were significant; in Management 59% (4 survey items out of 
7); in Staff Development S0% (1 survey item out of 2); and 
in Support Services 25% (4 survey items out of 16) , although 
in this category 75'o or 3 out of 4 survey items related to- 
direct student services were significant. Although survey, 
items whose mean scores were significant were scattered, 
the items exhibiting the greatest levels of significance 
(OC = .0005) were all in the area of Curriculum, In fact, 
All 7 survey 1 tems achieving levels of s igni f icance in 
Curriculum did so strongly (OC-005), Although other areas 
h'ad a greater percentage of significant items than Curricu- 
lum, the levels of significance attained by individual , 
items were weaker. 

Survey Instrument Anal ysis -Close scrutiny of the types of 
ratings awarded schools on each item was the basis of an 
analysis of ''weak'' questions. Five criteria' were used in 
determining which need further refinement These were: 
(1) number of "O's" awarded for an item; (2) number of 
"NA's" assigned; (3) number of ''M's'' assigned; (4) number 
of "half -points" awarded (Ccg., scores of 3.5., 4.5, etc.); 
and (5) no central point of tendency in, the ratings awarded 
for schools within each group. According to these criteria 
only two questions were found to be uniformly weak in both 
groups: one Curriculum item dealing with the relatively 
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new concept of parent education and one Planning and. Pro- 
gram Evaluation item dealing with the use of criterion- 
referenced tests in schools, (See item. 1,11 in Curriculum 
and item 1,3 in Planning and Program Evaluation, Appendix III-4) 

Both. groups of schools provided the survey instrument 
with about an equally stern test, Usir the five criteria 
set forth above, only 110 item-responses of a possible 
2009 or 5,47% presented problems. Of the 110 problem, re- 
sponses, the most efficient/effective schools contributed 
54 and the least efficient/effective schools, 56. 

The data is far from conclusive. However, it is in- 
valuable as a base for improving the process of program site 
reviews and contributes toward the next step in our search 
for those factors which 'm.ake a difference" in the instructional 
process. 

Results of Process Investigation 

As stated in the Introduction, the two ^general hypotheses 
for this study were: (1) procedures can be developed to 
conduct program site reviews of basic educational programs; 
(2) on-site visitations to selected schools can reveal real 
differences in quality of school programs. However, the 
Cost-Effectiveness Study and Assessment iFollow-up Task Force 
decided to evaluate the program site review process and in- 
strumentation in order to facilitate improvement. 
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Therefore, three committees were developed to design 
a debriefing procedure for those persons who participated 
in the program site reviews. This process was to serve as 
an evaluation of the on-site visitation procedure used by 
the Department. 

Debriefing Design , - -A sub-committee of the Task Force 
developed two instruments geared toward the investigation 
process conducted by visiting teams. One instrument was 
designed to query all fifty team members about the program 
site review process. The other instrument centered arou^.^d 
reactions of ten team captains to the. vis its . The survey ^ 
instrument for team members included 30 questions listed 
among the following categories: team organizational training, 
the visitations, the survey instrument, the exit interviews, 
and the timelines of data. The questions for team captains 
were centered around team leadership functions. The in-^ 
struments were given to a Debriefing Process Sub-Committee. 
Appendix IV displays the questions developed and used to 
evaluate the program site review procedures,- as well as the 
responses to those questions by team members and team captains. 

Debriefing Process . - -A second sub -committee .distributed the 
two instruments to program site reviev/ team members and team 
captains then collected the results of their responses. A 
summary of the affirmative and negative responses was pro- 
vided for each question. The debriefing process sub -committee 
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invited all team members to participate in group interviews. 
Sessions were scheduled in Ih hour blocks. Each session 
focused around team member responsibilities during program 
site reviews.' A session was also scheduled for team captains. 
Reactions and responses to each question were then given to 
a Debriefing Synthesis Sub -Committee . 

Debriefing Synthesis .- -The results of the debriefing were 
summarized and reduced to a manageable form. Steps used 
in the synthesis procedure are outlined below: 

1. The percentage o^ positive and negative responses 

for each question was provided. 
"2. The summary of responses of team captains and 

team members- was prepared in chart form. 
3. Recommendations based on percentage of affirma- 
tive responses were categorized as: 

a. general agreement - at least 841 affirmative*^ 
responses 

b. factors to strengthen - 60% to 84% affirmative 
responses 

c. consideration for redesign - less than 60% 
affirmative responses . 

Table III provides results of the debriefing synthesis. 
As the program site review is continued as an on-going function 
of the Department of Education, the^results of this evaluation 
wi!).l contribute to the/ improvement of the procfess. 
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... ^ 

This chapter has reported the results of the various 
program site reviews and the critique of the process con- 
ducted by Department personnel. The next chapter will 
report the major conclusions and recommendations • 

/ 

r 
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The foUowing infomtibn represents n snvthcsiied report frortoai:; niemhcrs and team captains concerning; the Droeram site 
reviews conductj^d in the Fall of \rb. Survey results related te the visits have k-eii or(;;mi:ed as follows: ' ' 

■). . ■ ' ' 

I deneral Agreement • at least 85: al'firniative resnonses. . 
ptors "t^TTrengthen - 60 ; to 8J' afiinmitire responses. 
Con sideration tor Re desjon - less than oO: affirmatii-e responses. 
I. SUMMARY OF RESPONSES BY TEAM CAPTAINS A\D TEAM MEMBERS 



General Agreement 



Factors to Strenijthen 



l.l 
1.2 
2.1 
2". 4 



2.S 

i.i 

2.8 
3.2 

3.8 

3.11 
4.1 



Three members to a team 

Sufficient expertise 

Realistic visitation schedule 

Adequate access to all school 

individuals 
■ Timing of visit appropriate from 

standpoint of schools 

School staff helpful 

Environment of school supportive 

Written instructions clear on 

survey instrument 
\ Evidence indicators used in a 

consistent manner 

Rating scale adequate 

Constructive exit interview 

experienced 



1,3 
1,4 
1,5 

1 7 
II 

J. 3 
3.5 

3.6 



3.7 
3.9 
3.10 
3.13 



II SUMMARY OF INFOmilCN BY IM CAPTAIN'S ONLY 
. General Agreement 



2. Adequate information to ansver 
questions .of team members 

3. Adequate infornation to answer 
questions of school personnel 

4. Adequate information to answer 
team's questions concernins the 
visit ^ 

7, Format of report adequate for 
initial attempt 



Review in area of expertise"^ 

Training of team 

Use of survey instrument 

Understanding of mission bv school 

staff 

Preparation of school personnel to 
respond to questions 
/School status data ^ 
Item statements self explanatory 
Nature and scope of time statements 
Prioritize evidence items according 
to importance attitudinal aspects 
of sciiooi personnel should be re- ' 
fleeted 

''Other" evidence indicators be 
elicited from school personnel 
Information available to document 
evidence indicators ^ ^ 
Definition of rating scale levels to 
identify qualitative differences 
Way to assess qualitative differences 
Exit interviews 



Jactorii to Str enfjthen 



Adniini-stration of survey 
Guidelines to team captains * 
Format of report 
Accuracy of school status data 



. Considerations for Redesign 

3,4 Item statement from broad to 

specif ic*^ 
3.12 Clarify rating of zero . 
5,2 Problems caused in securing 

1974-75 data^ 



Considerations for Redesi t;n 

Timing for organization of 
report 
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icndix IV contains the questions from Uiich the .s\iithcsi:cd answers were deriveJ, 



IV. CONCLUSIONS AND RECOMMENDATIONS 

A major study was undertaken by the Cost-Effectiveness 
Study and Assessment Follow-up Task Force that utilizied data 
from the 1974 statewide assessment program 'and the 1976 cost- 
effectiveness and efficiency study. Through this process, 
called program site review, new procedures were explored 
for determining the efficiency and effectiveness of selected 

y 

.K-3 programs in Florida public schools with relation to a 
variety of variables. The major purpose of the study was to 
determine the feasibility of conduct ing^ program site reviews 
of .selected schools in order to make recommendations for in- 
structional improvement- However, the ultimate goal is to 
provide information that will have impact on state and dis- 
trict policies, resource allocation, and strategies for 
improving public schools. 

Primary Conclusions .- -Significant conclusions from ■ thej ana] ys 
of 1976 program site review data indicated that: 

1. The observations revealed that the more efficient/ 
effective schools generally tended to score higher 
than the less efficient/effective schools on ^the 
items contained in the survey instrument. 

2. Both high and low ranking schools had identifiable 
areas of strength and weakness. 

• 3. The survey instruments designed and utilized for 
this task wore relevant to the pnr]ioses of this 
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study and can with modification and refinement be 



useful to the Department in improvement of the process 



4. 



Procedures can be developed to conduct on-site evalu- 
ations of basic education programs. 



\ 




$• The possibility of revealing real differences in 



the quality of school programs does exist and, the 



process of this study should facilitate the search 



for these distinguishing factors • 



Areas investigated were too broad and s 



liould be 



delimited in order to improve this process* 



7. Additional resources will be required t 



^ implement 



this evaluating and monitoring function, 



Secondary Conclusions . --Secondary findings s igni ficant enough 
to report are : 

^ !• The rankings of schools were based on assessment 
scores in reading, writing, and arithmetic at the 
beginning of third grade and the relationship to 
cost effectiveness while the evaluation instrument 
was concerned with broader indicators of effective- 
ness. Future efforts should, therefore, be concerned 
with integrating the two methods of evaluation. 
2 . The interaction effects of cortditional variables 



are more significant and meaningful" than individual' 



variables taken alone. Future research might be 



I great ly^enhanced if corresponding conditional 

van abi es and school learning are studied not only 
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as the summation of discretely defined skills, 
abilities, and systems but also in terras of the 
w interrelat iof?ship between these factors. 

3. The unavoidably two-year lag time in this study 
, between the collection and analysis of the 1974 

data and the 1976 program site reviews caused 
considerable problems in collec ^ng and interpre- 
ting d i in 1976 > This time lag should be 
shortened to the greatest possible degree. 

4. Rankings of schools should be interpreted as 
rankings based-^on assessment of selected K-3 
reading, writing, and arithmetic objectives rather 
than rankings of all grades and all programs offered 
by the schools studied. 

Recommend a tions . -v-^This initial study has received careful 
review resulting in recommendations essential to the improve- 
ment of the overall evaluation and moniloring endeavor. The 
mosl cogent ^commendations are: 

1. Although initial efforts were and should have been 
directed at grades K-3, program evaluation ai;id 
monitoring mus^ continue at this level until the 
objectives of the K-3 study are obtained. Ulti- 
mately, however^, evaluation and monitoring sl^ould 
occur on a systematic basis for all instructional 
levels and all instructional programs. 
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2. The evaluating and reporting instruments should be 
revised according to the recoiTimendat ions from the 
visitation and analysis teams repor^d in ChapTer III 
of this study. \ 

3. Although the training sessions for the \l976 on-site 
visits were valuable, the training of each team 
captain and team member for future visit-s should be 
improved in order to better meet the identified in- 
dividual needs of each captain or team member. The 
system requires properly trained and competent evalu- 
ation. 

4. Prior to future training and on-site visits, de- 
tailed guidelines should be published. These guide- 
lines should address the areas of preparation, 
execution and follow-up and should be based on 
analysis of 1976 reports. 

5. Closer integration between assessment results and 
program site review instruments should be sought 
to provide for greater congruency of findings. 

6. This study should be continued and expanded by 
spring of 1977 uti^lizing 1976 cost-e f fec^l^eness 
data. This would reduce the time lag ^^Ctweon the 
effectiveness data collection and analysis and the 
school vis i tat ions . 

Cons iderat ions for Future Study . - -As a result of this stucl\ , 
some important item? that need future consideration are: 



EKLC 
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The nuTTiber of schools visited should be substan^- 
tially increased and the quantity of factors studied 
should be markedly reduced. Incorporation of these 
two considerations would enhance and increase the 
possibility of revealing specific conditional 
variables which distinguish high and low ranking 
schools. 

Additional input from public school students at 
all instructional levels^ lay citizens, professionals 
outside the Department, and representatives of minor- 
ity concerns should be provided to aid the Task Force 
in its deliberations. 

Longitudinal evaluations are needed to determine the 
effects of categorical school programs on different 
kinds of students. 

Objective measures should be developed to assess 
conditions which adversely affect the education 
of high risk and minority learners and other non- 
achievers in basic school programs. 
Controlled alternative public schools should be 
established and funded as models for validating 
.the effect of conditional variables identified 
as this study is expanded. 

Evaluation should be made of factors which in- 
hibit attainment of school objectives and ut i li - 
zat ion of potent i al solutions to attain these 
objectives. Constant changes in school staff and 
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student populations are among t\}4 factors which 
hold potential as significant /factors . 
7. Delivery systems must be developed that utilize 
systematic approaches to provide technical assis- 
tance to ;neet identified needs as this study is 
/■ 

expanded. 

Both the , cost-effectiveness and assessment concepts 
and the foll.6w-up efforts reported in this study are evo- 
lutionary. The results must be seen as tentative and as 
a first step toward providing improved data relating to the 
effectiveness of instruction and the efficiency of school 
ope rat ions . 

Moreover, it is anticipated that continued development 
of dependable cost -effectiveness and assessment data and the 
follow-up bv professional educators will lead the Department 
to more definitive results and the concomitant ability to 
provide specific remedial suggestions to local school dis- 
tricts when indicated. In. addition, this process should 
lielp to more clearly delineate v/liich indicators facilitate 
successful school programs. This will greatly speed up the 
dissemination, diffusion, and replication of successful 
educat ional practices. 
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V. SUMMARY 

The Department of Education, like the Legislature," 
is concerned about the rising costs of public education 
and the sparsity of information about educational effec- 
tiveness and its relationship to costs. The purpose of 
this project was to determine the feasibility of con- 
ducting program site reviews of selected schools in order 
to make recommendations for instructional improvements, 
specifically, in the basic skills areas of reading, writing 
and mathematics. The two general hypotheses for this study 
were: (1) Procedures can be developed to conduct program 
site reviews of basic education programs . (2) Program site 

reviews at selected schools can reveal real differences in 

'. ^ ' 
quality of sch(\ol programs. 

■ ' \ \ . ' 

Another go^l of this cost-effectiveness inqu-iry was 

to identify and discern evidence of the in-school variables 
(indicators) which made a significant difference in the 
learning process. Selection of the K-3 schools for visita- 
tion was accomplished by this design: 25 of the most effec- 
tiye schools of the upper end of the ranking as reported by 
the Department,"'' and 25 of the least effective of the lower, 
end of the ranking. 

The reader should note that 1146 schools with K-^ 
programs have been properly assessed and ranked. Therefore, 

'''Florida Department of Education, Indicators of Effec- 
tiveness and Efficiency , Par t I^, 1976. 
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some feel that a larger sample is needed before meaningful 
conclusions could be drawn. * ^* 

The follow-up study, especially the collection of 
data, was a joint effort of the various bureaus within the 
Department, The interviewers were trained and then sub- 
divided into teams composed of a captain and two team, members • 
Teams visited up to five schools for the purpose of collecting 
the data. The project^as coordinated by the Task Force on 
Cost-Ef f ect rveness Study and Assessment Follow-up, chaired 
by Dr. J. W» Crenshaw. 

The methods of statistical analysis of data used iii 
this study was designed to: (1) look for the presence of 
significant differences between tlW^most efficient /effective 
schools And the least efficient/effective schools for any 
two selected matched pairs of scores;* (2) identify weakness 
in any questions in the survey instrumenc; and (3) formulate 
recommendations and conclusions. 

The three statistical procedures provided meaningful 
information in the determination of di f f crences between the 
two groups of schools, A comparison of the mean scores or 
ratings for each item for all schools within the two groups 
revealed decisive differences. The most ef f ic ient /e f f ec 1 i ve 
schools had a higher mean score than the least efficient/ 
effective schools on 39 of the 41 survey items. 

However, the analysis of variance was the most re- 
vealing metb«d used. Although areas of significance scattered, 
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the areas of greatest significance were all in the area of 
Curriculum. In fact, all seven items achieving levels of 
significance in Curriculum did so strongly (OC+.0005). 
Although other areas had a greater percentage of significant 
items, levels of significance were weaker. 

Apparently, indicators evaluated in the areas of 
Curriculum, Program Planning and Evaluation do have a posi- 
tive impact on instruction at the level and sub j ec t areas 
studied. Please see Figure 2 in Chapter III to see 
which indicators within these areas made a significant 
difference and which ones apparently have negligible impact 
on teaching the 3 R's. 

Tt must be remembered that correlation may not mean 
causation. At this point there can be no absolute certainty 
that we have identified the factors which influence student 
ach ievement . 

The results of the study indicate that it is feasible 

to conduct program site reviews of schools for the purpose 

of making recommendations for instructional improvement. 

ft 

Both hypotheses were answered positively: (1) procedures 
were developed to conduct program site reviews of basic 
educational prourains; (2J program site reviews at selected 
schools can reveal real differences in quality of school 
programs. After reviewing the process it has been con- 
cluded that the survey instruments will have to be improved 
and the areas under i nvest i^^at i on were too broad. In addi- 
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tion, only one ^person rated each indicator at each school. 
The state of the art and the small number of schools visited 
make it mandatory that this study not be considered defini- 
tive. With greater experience at more schools ,. the develop- 
ment of refined instruments and procedures, and by having 
a group of people evaluate each indicator instead of one 
person, more concrete conclusions will be possible. As the 
relationship between program indicators and student achieve- 
ment become more obvious, the Department will be better 
equipped to evaluate and recommend corrective action to 
local schools. 
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state of Florida \ 

PepartQient ofEducation 

OFFICE MEMORANpU M 



CAPITOL □ 
KNOIT □ 



ROOM NO, 



OTHER. 



to« Dr. Joe Crenshaw _^ \ [ \ ■ ' ■ 

frO"*' Woodrow J. narden i^cnrO^-*^ Vfly£iu..A^ *ate 



SUBJECT: 



K-3 Program Evaluation 



ERIC 




April 26, 1Q7fi 



In order to fulfill the strategy on compiAting the study on "indicators 
of Effectiveness and Efficiency K-3 PrograA," I am appointing you as 
chairman of a task force of DOE staff membets to implement the following 
by May 7: 



1. 
2. 
3. 



Review the three step process as identified in Part I^ of the study. 
Review the data in Part I. 

Review items of data and characteristics of schools that will be 
analyzed in Part II. 

Complete strategy for development of Part III of the study and monitor 
implementation by 

a) Identify additional data or characteristics of schools that will 
be collected or observed by members of the DOE staff through an 
on-sight visit to determine significant differences in the schools 
identified in the top and bottom 10%. 

Develop a process and strategy whereby two (2) teams could visit 
four to six schools over a period of time between May 10 and May 26, 
1976, as a pilot project for future on-sight visits on a larger 
sample of schools in the fall of '76. 

Evaluate pilot study process and data collected and revised strategy, 
etc. appropriately for fall visits on larger sample of schools. 



b) 



c) 



It is important that both teams be given Instructions on the process and 
the data to be collected and chc^racterlstics to be observed in the limited 
time available. 

The overall goal of analyzing the effectiveness and efficiency data is to 
provide input to plans that would have an impact on state and district 
policy and resource allocation and the strategy for improving the schools 
ef fectiventiss and efficiency. 

It is recommended that task force members survey on-sight visitation team 
members for ideas and suggestione rs the overall plan is developed. 

The task force members assigned to the above task and their primary 
responsibility are as follows: 



J. 
J, 



Crenshaw 
Roberts 



J. Swans on 

T: Fisher 

E. Allen 

A. Puryear 



- Chairman of task force & starf development indicators 

- Part I and II analysis and development of ultimate 

plan for improvement 

- Additional data needs in MIS system and data collection 

- School program evaluation system indicators 

- Format of Part III report and data control 

- Curriculum indicators (elementary) 



The Foreword of this report explains the three reports, Part I, Part IT and 
Part III and their relationship. 
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MEMORAHDUM 



Dr. Joe Crenshaw 
Page 2 

April 26, 1976 



R, Bazzell - Hanagenent l&iLcatort 

E. Groover - Program Stipport Service Indicators 

J. Patrick - Curriculum Indicators (secondary) 

Anticipated on-sight visitation tessas will be made up of DOE staff members 
from the following sections where appropriate based on strategy developed: 



R&D - 2* 

Staff Development Programs - 2 

Early Childhood & Elementary Education - 7 
Exceptional Child - program Development \ 

& Evaluation - 2 

Student Services - 2 

School Library Media. Services - 2 

Compensatory & Migrant Education 4 

Human Resource Services - 2 

Assessment & ^Planning Services - 4 

District Management - 4 

Food & Nutrition Management - 2 

Total 33 



*Member6 to be included from each section 



cc: Julian Roberts 
Jim Swanson 
Tom Fisher 
Ed Allen 
Ada Puryear 
Ray Bazzell 
Eloise Groover 
Lee Foberts 
LandlY S tie tier 
Gilbert Gentry 
Carey Ferrell 

R/b 
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GENERAL SCHOOL INFORMATION 



DISTRICT NO. ' . SCHOOL NO. 



1. The advisory council at this school niet regularly; YES M 

I The advisory council at this school participated in idenUfying nei)ds, goals, and priorities* YES ' N O 

3, Parents of children in this school i^artlclpated in identifying needs, goals, and priorities. ' _JES W 

A. iTiis school had a planning conmittee, \ ^ _YES ^NO 

(If yes, list the number and types of members, e.g. 2 teachers, etc,)\^ 

\ 



fs, There was an orientation program for all new students at each grade lev^l. V ^i'ES W 



6. Inservice participation was mandatory at this school. ^ 



\ 



YES 



7. Estljnate the percentage of teachers who participated, in at least 15 hours of Inservice Training. 

B. Did your district office employ and make available to this school: '\ 

.. . a. a research and evaluation specialist? ' YES 

b. curriculum specialists? • \ YES 

9. Did the principal have Jinal authority in einploying staff for this school? \. YES 

T 



, 10. Has there office space set aside for the exclusive use of student service personnel? _\YES ^HO 

11, Was'-Che library used as a classroom for basic instruction? 

\ ' 

I - ■ . s 

12, Estimate the number of student disciplinary actions necessary by principal or assistant principal. 
' 13. How would you describe the location of this school? 

q \ Urban - Urban - 

0 Inner City _ Not Inner City Suburban Rural 

U. Estljate the percentage of staff whose ages in 1974-1975 were; 

a. less than 40 (years) 

b. 41 - 60 (years) 

c. over 60 (years) j • ' 

ERIC 

Coocieats, If ar>y: 



SCHOOL STATUS DATA 
1974-75 



District Name 



School Name 



STAFF DATA 

Administrative Aides 
Guidance Aides 
Mtdla Aides 
Teacher Aidel 
Volunteer Aides 
Instructional Staff (FTE) 
Teachers - 4 yrs. Experience 
Number Student Teachers 
Student/Teacher Ratio 
I With Rank II or Higher 
Teachers - White ■ 
Teachers - Non-white 
Niw Hi'*es - Professional Staff 



SCHOOL DATA 

Grades in School 
Population Area Served 
School Location 
I White Collar 

X Families With Income Less Than $3000 
A^'erage Annual A-V Expenditures 
Number Library Books 
Ratio Printed Material per Student 
A-V Equipment per 100 Students 





STUDENT DATA 


Ifllitt: 


Non-white 




Total Membership 






55 


3rd Giade 








6th Grade 


i 




ERIC 


. Suspensions 
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Dlstrict 'Name !ibr.rit:t f'o. _ S. hcMil 

School N.iiiic Si'h(H)l Nil. 



SCHOOL STATUS SURVEY': 1974-1975 SCHOOL YLAK 



Rater tnsi ntctiDus : 

A. li.i^I". a nd Kvt dence 

(P !\at«? the overall qualitv Dt each itum obscrvud i?- 1 1 - school usinr, t.l»i^ evidencr i iid i en t nrs .is t Ijl- hdsts 
tor lornitng your profrsslunal judgement. Y(nir r.irj.i.. ^ji^nild !h- based on tlic •IVl:''^ i L inUQ^Liy of all 
evidence Indicators. Ihe absence of any one InOi'.al'^r should not be con.sldiTed sul'fic lenL t(» >;ive a 
school a low rat' .i>' • the Item. The evidence iinlicutors provided for each item are not exhaust Ic : *ind 
vou may wish v > . tli-r indicators as well. (Please record .iddiriona! indi editors used in the "F.v.deni-e" 

' <i ) umn . ) 

(2* i<f.'member you w.ll be -.isin^ 197A-1975 data. Kxajnine or spot cliirk ■■■ rvldonce or (<tiiei spei-iiie docu- 

lunt.itlr.n, and conduct interviews wliercvi-r pcissible wltli tlie appropr i ir school staft mL'm})» r or pan-nt 
i<leril iJ led in. the item. 



i\) \hi.' rating sc;ile siort- which you will assign sliould represent your professional judy^jement <ibout how well 
; fie s.-hool or stafi n i .mii' 1 t shed or performed the Item during the acliool year 1974-197'). 

. -w well the item was performed are as follows: 

. ,r. ' L be evaluated. plain in ' Item Kv.ilwar ion'' colunin. 

ScU^ ^i.atf performance was far below what pr(jfessional standar<ls Indicate 
r.houid be accomplished In this area. 

School /staff performance was poor, but acceptable, in relation to what pro- 

iei^sio-jal standards Indicate should be accomplished in this .irea. 

Schor)! /staff performance was average to what professional standards indi^rato 
should V>^^ accmnplished In this area, 

Schonl/staff performance exceeded wliat professional standards indicate sliould 
he .Kf-omplished in this area. 

School /staff performance was superior to what professional slandanis iudirale 
should be accompUshc.l in this area and serves as a model of practice. 

(1) Indicate the stron^'.ths and/or weakjiesses of each aurvey item which does not derive primarily from using 
1974-1975 data. 

(2) He specific about il i M inult les resulting; from item content, documentinR the evidenee imiicators, or frnm 
applying', the scale ris defined. 

■ ESE T i<) Rater Name Date ^_ 

•EXP. 4/30/77 



\ 



' .' t a 1 c dff init lt)ns r i i iv'i 

0 - Can' t Rate 

1 - NjL Acceptable 

2 - Inadequate 

3 - Sat iaf act(»rv 

4 - ■ (kiod 

5 - F.xt.Miip 1 ar y 
C. Ttetu livaluation 



ERIC 
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CURRICyiUH: 19/4-1975 

District 'lo. ^School No. 



EVIDENCE 



1.1 Classroom groiiplnf((s) .ii:<:.m\l?ued I 1. Tasks and areas of responuibiiity for 



unique student needs 



each staff raembar (I.e. teachers, 
volunteer?, aides, tutors) wnro 
described and understood - policy 
book etc. 

I. Provision was ruadc for large group, 
small group and Irdlvidual instruc- 
tion. 

3. Classroom grouping reflected varying 
student interests and progress, 

4. Feedback from parents, students, 
teachers,' etc*, about claBsrooni 
grouping resulted in change. 

5. Flexible scheduling used where 
apprcpi'iat.a. 



1.2 The instructional progtaij pr^wided 
for continuous student progress. 



Sequence of instructional objectives 


0 - Can' I Ku':e 


established eaphasizlng cognitive, 




affective and psychomotor knovledge 


I Not Acceptable 


and skills. 




2 " Inadequate 


Criterion-reference evaluation was 




utilized. 


3 - Satisfactory 


Individual student evaluations were 


4 - Good 


used to develop Instructional pro- 




grams. 


5 - Exemplarv 



4. Systt'-iatic observation was usci!. 



1.3 Prescriptive casks, materials 
and methods were made use of 
to meet the diagnosed needs 
of students. 



ERLC 



The variety ol materials, methods 
and tasici uiij nt vide enough 
to provide for the diverse abili- 
ties and leamiHR r^te of the 
students. 

Alternative instrucrlonal tasks were 
available to students for specific 
skill mastery. 

A developtnentaT textbook series or 
produced in3tru(3ftlonal materials 
(contracts, prescriptions, etc.) 
appropriate to the reading level and 
instructional needs of the students 
were utilized. 



0 - Can't Rate 

1 - Not Acceptable 

2 • Inadequate 

3 - Satisfactory 

4 - Good 

5 - Exemplary 



' Can't Rate 
Not Acceptable 
Inadequate 
Satisfjctory 
Good 

Exemplary 
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CURRICULUM: 1974-1975 



'District No. SchooUo. 



i'«iic ucMi< po^m:ml J:,i;cnent, mtc the ^i^clib i each ; chsemd ik thi^ ^oho-i ;V,:w X't .-l^.tvpti^/e" 11} to "Eier>u" Hi hmd 



on 



ITEM 



SCALE 



1,4 A record-keeping system existed 
vfhlch docuiaented continuous 
student progress, 



1. Staff members were deiaignated to 
develop .ind maintcia Individual sfjdent 
records. 

2. Records were kept current, .systematized, 
organized and readily accessible, 

3. Teachers regularly reviewed recorded 
data for each student raakinf> necessary 
prescriptive adjustments. 

^. Records providing understandable in- 
fomgtlon to the teacher were used 
in planning, development and evalua- 
tion. 



0 - Can^t Rate 

1 • Not Acceptable 

2 - Inadequate 

3 • Satisfactory 
4' - Good 

5 - Exeniplary 



m tvMIOH 



A 



(} 

v 



J , 5 The InstructiCiinl progra^i provided 
3 coaprcb^^^slve and balanced K*3 
curriculum. 



1. Basic skills J,, e. reading, cotamunlca- 
tion writing and arithmetic) were 
emphasized throughout. 

2. Adequate attention was given language 
artB} music, art, social studies, 
science, health and physical education. 

3. Cognitive, affective and psychomotor 
knowledge and skills were integrated 
into the Instructional program. 



0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Satisfactory 
i - Good 

5 ' Exemplary 
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L6 The instructional program provided 
opportunities for students to. 
develop positive self-concepts. 



1. Positive reinforcement of learner 
success was frequent. 

2. Opportunities were provided for 
students Co develop attitudes of 
self-discipline. 

3. ' Opportunities were provided for 

dealing; with the feelings of others 
• and the'devpJopmcnt of trust In peers 
and adults. 

4. A supportive classroom environment 
emphasized iitual respect. 



0 - Can't Rate 

- Not Acceptable 

- Inadequate 

- Satisfactory 

- Good 

- Exemplary 



EKLC 
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CURRICOLUH: 19W-1975 



Diitrlct No, School No. 



HEM 



,7 The clasdroom learning environment 
wag nleasant and s.i^e facilitv. 



1,8 A variety of methods and raateriah 
were utilized in learning activi- 
ties. 



1.9 The instructional program protaoted 
multi-cultural understanding among 
students of different racial, 
cultural, dnd socio-economic 
backgrounds. 



tVlUEiCE 



CALE 



1, Fleayant colors 

i'OUvi lu'J>tiiV,; 

3. Reasonable noise levol 

^. Comiortable working stations 

5. Clcissroofn clean, nea: and propirly 
ventilated 



Methods and materials were designed to 


0 


- Can't Rate 


teach the instructional objective 






cr goal. 


I 


- Not Acceptable 


Method and raatorial variation was 


2 


- Inadequate ' 


utilized based on instructional need, 






pacing, student interest, time and 


3 


- Satisfactory 


availability. 








k 


- Goud 




b 


* Exemplary 



1,10 Home-school communication by 
school staff was appropriate to 
parents. 
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1. Activities included ethnic studies and 
history of contrlbuticnj and events. 

2. Program provided for raulti-cultural 
events and activities. 

], Multl-cultiinrfTlnstruction v.-^s incor- 
porated ijifo subject matter other 
than social sciences. 



Contact parents to detemine tliat; 

1. Parents could easily contact school 
staff. 

2. Bilingual written comunications 
were utilized where necessary. 

3. Communications were kept in a direct 
easily readable format as often as 
appropriate. 



0 - Cin't Rate 

1 ' Not Acceptable 

2 - Inadequate 

3 - Satisfactory 

4 - Good 

5 - Exenplary 



0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Satisfactory 

4 - Good 

5 - Exemplary 



0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Sitisfactory 

4 " Good 

5 " Exenplary 



ITEN EilOdTIOS 
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CyRRICULUH; 197M975 



District No, Schoo^ No. 



i/8wg ym profmioml Mijmmt, rate tk qualil^j of di'h itc; ihi^cvKd in this school fm 'Wi t .■Lveftarl.j" fl) to "F.:ex)ki^" fJJ U^ed on the 
enience pmiiei by rli>cling ths appropnate mle nurki'. Phase cxfkir, an;/ item Mch MKot k rUci 



m 



l.U The parent educaLlon program luet 
the needs of the parent, 



1.12 The K-3 Instructional program 
emphasized articulation ind 
coordination. 



6t 



ERIC 



EVIDENCE 



Contact parents to detemiine that: 



Program activity vas designed In 


0 


- pan' h Pil-P 


conjunction with parents or by 






parents. 


1 


* Not Acceptable 


Trograra vas based on parent needs 


2 


- Inadequate 


and interests. 






3 


- Satisfactory 


Program vas evaluated by parents. 








4 


- Good 


Program vas offered at a time and 






at locations convenient for their 


5 


- Exeiplarv 


participation 




Program vas offered free-of-charge, 







1. Preschool and child care staff 
nembers were included in planning 
the K-3 inservice program. 

2. Joint planning for the use of 
comiDunity resourcas^ field trips, 
etc.) vas encouraged. 

3. Student records at each level vere 
communicated. 

4. Provision was made for the involve- 
ment of all levels (Pre-K - 6) in 
program planning, implementation, 
modification. 



„4 . 



0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate ' 

3 - Satisfactory 

4 - Good * 

5 " Exemplary 



■ iTffl mm 
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PLANNING AND PROGRAM [yALUATIOfl 15/4-1975 ' 



Oistrict No. School No. 



^1 ITEN EMTiON 



l.l The Instructional piMirun 
was a direct outgrowth 
of the school's planning 
process, 



1.2 Nornhrefercnced test 
data were utilized In 
program developient 
and evaluation. 



ERiCl 



1. issesiiiaent of educational needs 
of students was conducted, 

2. Resources and constraints were Iden- 
tified (i,e. cost, time, talent, etr,). 

3. Priorities vere establii5hed for the 
instructional program as a result of 
1 and 2 abov^^ 

Written goals and objectives with 
alternative strategies were fonaii- 
lated for the instructional program/ 

5. Total faculty was involved in process. 

6. lapleaentfltlon schedi'le was set. 



1. Test data were used to make instruc;- 
tional decisions about students conr 

' cernlng promotion, retention, ac- 
celeration ana remediation* 

2. Goals and objectives wer,e formulated 
based on needs identified froio test 
results, 

3. Test data vere used to evaluatii 
attainment of goals and objectives. 

Progrgm modification resulted fr;,Ti 
test data analysis. 

5. Program priorities vere re-examined 
based on test data analysis (l,e. 
fiacal, personnel, material nisoiirces). 



" Can't Rate 

- Not Acceptable 

- Inadequate 

- Satisfactory 

- Good 

- Exemplary 



0 - Can't Rate 

- Not Acceptable 

- Inadequate 

- Satisfactory 

- Good 

" Exemplary 
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EWLUAT OH: 1974-19/5 



District No. 



School No, 



mt ^wiiiM k'cirolw the .^wprlir? sede mhy. ?l?')se i'S^^diK (TO nr. mien mr. cf wtrJ. 



ilc" (1) to "txendx".!" ft) issei on the 



1.3 Criterion-referenced test 
data were utilized In program 
development and evaluation. 



mm 



L Test data were used to make instruc- 
tional decisions about students con- 
cerning promotion, retention, ac^^ 
celeration and remediation. 

2. Coals and objectives were formulated 
based on needs Idenilfled from tef=t 
results. 

3. Test dat.^ were used to evaluate 
attalmneit of go;»'^s and objectives 

4. Program niodlflcation resulted from 
test data analysis. 

5. Program priorities were re-examined 
based on test data analysis (i^e. 
fiscal, personnel, material 
resources), 



1,4 Non-achleveinent data from 
tests and observations were 
utilized In program development 



and evaluation. 
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1. Observational techniques, and test- 
ing of student attitudes, motivation 
and career awareness were used to 
identify student needs and formulate 
programs. 

2, Test data weri used to evaluate and 
modify programs, 



0 - Can't Rate 

1 - Not Acceptable 
• - Inadequate 

3 - Satlsf ctpry 

4 - Good 

5 - Exemplary 



ERIC 



0 - Can't Rate 



1 - Not Acceptable 
? -^nadequate 
3 - Saiisfactory 



k - Good 



5 - Exemplary 
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STAFF DEVEOPI^^flT; 1974-1575 

'\ District No. School No, 



Using vo:ir ^voyddh^'^l J:^^7r-,^>:t; ^fi^ ,';.'.r:vj ;Von "^^t ktnii^t^^iW' (Jj (5) ha^d on 



.ITEM ' EVIDENCE 


\ SCALE 


ITEM EVALUATION 


1.1 The inservlce education progran met 
the needs opihe school ataff , 


1. School f^caff were involved in neuds 
assessment co determine which 

\, activities to offer. 

2. A varied selection of activities 
was offered. 

3. Activities offered were appropriate 
to the instructional or service 
delivery problems of the school 
staff. 

4. Inservlce activities were convenient 
to participate in, 

5. School staff were given the 
opportunity to evaluate inservlce 
programs. 


0 "\;an't Rate 

\ 

1 - N'DtxAcceptable 

\ 

2 - Inadeqiiatii 

3 - Satisfacti)ry 

4 - Good 

5 - Exemplary 




1.2 Skills and knowledge obtained 
in inaervlce programs were 
applied in clasaroom situations. 


Conferences were held with principal 
and other school personnel. (Include 
inservlce staff meinbers' recollections^ 


0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Satisfactory 

4 - Good 

5 " Exemplary 


4 
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mmw: --mm 



District No. School No. 



'^Exct'x^'/ h-^td on 



m 



IJ The principal delegated responsi- 
bility for the operation of the 
school program to the staff, 



SCALE 



I. 


Grade level chairman, lead tencht-rs 


0 - uin't 




etc. were appointed, 








1 - Not Aoa'pt.ihle 




Staff felt that when they vero j^iven 






responsibilities they were aho 


2 - Inade^jUdte 




given the necessary ,iuthorlty to 






make decisions. 


3 - Satisfactory 


3. 


Staff were given release im :o 


4 - Good 




attend subject area meeting?. 








5 - Fxcmplary 




Adniirlstrative assignments were 






distributed equitably. 





1.2 The classroofu environment reflected 
mutual respect between teachers 
and students. 



. L Disciplinary referrals to the office 
were not excessive.' 

2. Classroom tasks were carried out in 
an orderly manner, 

3. Students worked independently of 
teachers. 

^, Students showed a willingness to 
assist the teacher in the mainte- 
nance of the classroom and related 
racilities. 

5. TeachLTs reflected Individual 
concern for their students. 
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0 - Can't Rate 

1 - Not Acceptable 
I - Inadequatt^ 

3 - Satlsfactorv 
k - Good 
5 - Exemplary 



ITffl EMIIOH 
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'Jskj j/oiiP pvpJessM .jimmt, rate tk^ aalitj of SuM^i in to z^kool jn 

evi'hm mvided hu :»:'j':'I:>w im Tpmrktc iioale Kmv. FUm explain lU^i i^hick ( 



canwt he ra'^tc.' 



District No. School No. 

:o "Exewkvf (5j bmim the 



m 



1,3 The school staff explored various 
techniques In addition to corporal 
punishment, In order to maintain 
discipline, 



1.4 School policies and procedures were 
clearly explained to the staff. 



1.5 Priiirlpal ^iia'-ntandlng r-i 
support! uf ;;raff pro' ems 
;nd needs. 



1. School policy or directive jjovcrning 
disciplinary action enphasized 
alternatives. 

2. Staff used alternative measures to 
discipline students. 

3. Parents were Involved in school 
discipline problenis. 



1. Written policy statement was 
available. 

2. Staff felt they clearly understood 
policy and procedure pertaining to 
personnel, discipline, etc. 
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1. Stiff felt principal stood buhind 
Ciifiiii on disciplinLi, pronotion or 
Instniri ioaal problems. 

'K Staff felc principal was re^'^i^y 
available to sec then when 
necessary. 

3. Staff felt principal continuously 
raitord and r ivsen^^itive to 
iichoOi socLil uimate, 



EKLC 



SCALE 



0- Can't ':.',!r 

1 - Not /ui. 'able 

2 - Inadcq'jaNe 

3 - Satis. :.ory 
k - Good 

5 - Exe^p . . y 



0 - I'.'n't Ute 
1'- Not ft ;,^ptable 

2 ■ I vequKe 

3 - Satlsfa-' f^ry 
4 -Go.' 

5 - Exe:iiplaty 



0 - Can*t :^.aL 

1 Vu;: ■ ^.bl€ 
''I' lequate 

3 S;ttstacLarv 
■ - Good 
; - Exemplary 
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HANAGEHEIIT: 197M975 



District No. School (io, _ 

Using \jOur profmioml ^id^a^nt, v^:c t'u' yxdUu i .m.-' fvr :hs>:}Vd ir tkU ich:ol ]Ki "Hot ^^octtdk" (U to "EimW' (Si based ok ' 
eitidence vmidcd b dvoLim the xrite ^u^lc r-dcr. ^z^l^i^'m it m mc'^. omot k ntd - ■ 

sir ! 



IIEH 



1.6 FiJcal resource's allocated to the 
school were adequate, 



IJ School reqords wer^; useful in 
managing the operation of the 
school, 



EVIDENCE 



L Budget requests were filled based on 
the original reconmiendations from 
the staff, 

1, Classrooni tquipmont, supplies and 
materiali), etc., were sufficient. 

3, Facility upkeep was adequate. 



0 - Can't Rne 

1 - Not Acceptable 

2 " Inadequate 

3 - Satisfactory 

4 - Good 

5 « Exemplary 



What: was the extent of record- 


0 


-Can't Rate 


keeping that the principal re- 






quired of teachers? 


1 


- Not Acceptable 


Were students' cumulative folders 


2 


- Inadequate ■ 


current and in compliance with 






regulation, etc.? (Spot check) 


3 


- Satisfactory 


How -often were student test 




r 

- Good 


results consulted? ■ 










- lixemplary 


Nere personnel records organized, 






iirrent and utilized? 






Were school financial records 






organized, current, posted and 






utilized? 






Were property record? nalntalned? 






Were written records utilized in 






making curriculuni decisions and 






changes? 
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SUPPORT SERVICES: 1974-1975 



Using i^m profsBsicml ]\j^mM, rate ik ^lity of each item ohaemd in this Bchool fm %t IcoeptcbU" (1) to 
wufangg provided ciToling the afpvopmte soale nmber, Fleaee explain an|/ item uWofi emnot he rated, 



District No. School No, 

^ [i) ksed on ihe 



m 



1.0 LIBRARY AND MEDU 



1.1 The school library nedl'a center 
■"provided facilities for a vari- 
ety of simultaneous activities, 



.2 Stidents and. staff had ready 
access to the library-media 
center, m/.terials and equipment 



1. Facilities were arranged so as to 
allov structured and unstructured 


0 


- Ctti't Rate 


groups, and individual activities 
siiultaneouslyi 


1 


- Not Acceptable 


I Facilities included: 


2 


- Inadequate 


a, Table and chair seating 


3 


- Satisfactory 


b.. Individual study carrels 


4 


- Good 


c. Conference room or rooms avail-* 


5 


- Exemplary 



able for small groups (4-10) of 
students. 

d. Large group (12-35) activity 
area for instruction, storytell- 
ing, film viewing, etc. 

e. Individual and group listening 
and viewing facilities 

f. Browsing area with displays, mag- 
azine racks, informal seating 

g. Media production area 



• SCALE 



1. Media center location was convenient 
to classrooms. 

2. Students were allowed access to the 
media center individually or in 
groups at any time during the school 
day, according to need, regardless 
of any clftt^'i achcduHng^ — 

3. The media center was accessible to 
students at least 1/2 hour before 
and after school hours. 

Students and staff had information 
and access to all types of media 
(prlAt and nOn-print) available In 
the school or in other location. 



0 - Can't Rate 

1 " Not Acceptable 

2 - Inadequate 

3 - Satisfactory 
k - Good 

5 - Exemplary 



ITEM EVmiO! 
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SUPPORT SERVICES: 1974-1975 



rvfict No. 



Lking pur ^vofeesioml jidgmnt, me trie ^fialit]i of each ohsemi in this school fm %t L'ceptat'-'^ (l! to ^^Exewldf^^^ 
evidence pmided bij circling the cipvropricte ijcde rMer. PUqs^ cxvljiih li^iy it^r mioh cannot he Ntei 



School No, 

(i) based cn the 



m 



1.3 Media centei^r personnel made ac- 
quisitions based on input froni 
teachers, students and parents, 



1,4 Hedia center nacerials were 
appropriate to learning needs. 



mm 



\. Jk media specialist was able to 
describe and document systematic 
efforts to solicit recowndations 
for materials to be acquired, 

2, Teachers, administrators, students 
and parents were able to describe 
efforts made by the media gpecialist 
to solicit recommendations and be 
able to describe instances in which 
recoTDDiended materials were acquired. 



30 Media center activities were 
appropriate to learning needs. 



1. The media collection; ' .^ 

a, Included a variety of types of 
audiovisual materials as well 
as ^ooks, magazines, newspapers 
ai^ pamphlets* 

/ , ■ 

b, ^included materials whose range 
■jol difficulty was appropriate 
/ to the ability range of the 

/ students in the school 

/' 

c, Included materials whose subject 
matter vas appropriate to the 
Interests of the students in the 
school, 

d, Included materials appropriate 
to the curricula: needs of the 
instructional program of the 
school, . 

e, Was being continually evaluated^ 
updated and enliarged l: pcovidv 
for changing needs 'ind iiafi;.-jt:5, 



scale 



0- Caij^t Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Satisfactory 
h - Good 

5 - Extmplary 



0 - Can^t Rate 

1 - Not Acceptable 

2 ■* Inadequate 

3 - Satisfactory 

4 - Good 

5 - Exemplary 



1 



ERLC 



Pupils were provided wlix. :i pj'nnod 
program of instruction v) st-udy 
8kill3. 



2. The media center initiated activities 
designed to motivate readings (i.e. 
storytelling, individual reading 
guidance etc), 



0 - Can't Read 

1 - Not Acceptable 

2 - Inadequate 
3'- SatLsfartory 
'4 - Good 
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District 



Scliool No. 



v;-;ii' ;. ;,r k:. , ' i'V.k Uh ; 



MO'.:!' : • 



r 



EVALUAIIO^ 



l.f) Au(li^visL)al L'qi![p;:u'nl i.'js ,K|t 
I quate to support lh<' instruc- 
tional fro^m, 



in sufficient luaititic^i to r^a 
instruct |.-i!ul needs in classrojnis arhl 
a:Kl in the raedli u'luer, 



" Can't [\,iti 
1 - fV'ivpt.ihlt' 
I 1 - Inaflii|ii.3ti.' 

lypctj or cmdiov'isiul eqiiipintni avail- 

wtTj appri\)ri,itt' to tho types ' ,1 - S.uisfaa.n-v 
and qiKintities of audiovisual ?iah'- 
rl.ih <-)VJib.ble in t,ie sJiuol, 



Tvpcs uf audiovisual i-qiiipmeat av.iil- | 
able were appropriati' for hotli griuip 
and individual use, 



.7 The llbrary^iiiedta speeialist 
provided teachers with tech- 
nical assistance in the plan- 
ning of Instructional activii:Ies 

and the production of media j 2. Library-media specialist va? a neiTiber 

of curriculum cotitmittees. 



Planning actlvlt' in ir:luded deter- 
mining why, what apd ' ;w media was 
used in instruction. 



used^^n I as t rue t Ion » 



3, Pruduction of at least slides, tr;iiis- 
parencies, audio-tapes, etc. was 
evidenced. (Some production took 
place in tV district center). 

Production scr\'ices were availablt: 
both teachers and students, with stu- 
dents given opportunities t,i create 
their own media, 



1 - LXi'jplary 



0 - Can't Rare 

! " Wn Acceptable 

'I - Inadequate 

3 - Satisfactory 

I ■* - Good 

I 
I 

I ) - lixeitjilary 
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SUPPORT SERVICES: 1974-19/5 



District 



School No. 



Using pofesBionil ^uimcnty me 



ludl:^]!' i\iSii iter iseivd in tl:ic ::ik"' '^!ht .\'j.'cptat^U^^ (V to ^^Exeiriploif^ ibl hmd on the 



8i 



ITEM 



mm 



2.0 Smm SERVICES (Guidance 
Counselors, School Psycholo- 
itlsts, School Social Workora 
and Occupational Specialists), 

Z.l The student service pro- 
gram v.is cocrdln.HL'ii Md 
its functions clearly de- 
lineated. 



ERIC 



2.2 A vTitcen referral and 
foUow-ap system providea 
meaningful feedback and 
increased services to 
staff and students. 



1. Faculty and students can name 3-^ 
functio'\i» of student sei^lces per- 
sonnel. 

2. Schoc.l personnel can identify vho 
Is lesponsible for school coordin- 
ation of services. 

], Team pro(edures were used In stu- 
dent oenlces. 

4. Brochures and role descriptions 

of services were provided for stu- 
dents, staff and parents. 

5. Special meetings were held to 
explain student personnel services 
to students, staff and parents. 



m 

0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 

3 - Satisfactory 

4 - Good 

, 5 - Exe.'oplary 



1. Written referrals and reports were 
found which Included practical rec- 
omendatioiu to staff. 

1 

2. Follow-up ienices for stucmitss 
were docujifinted. 



0 - Can't Rate 

1 - Not Acceptable 

2 - Inadequate 
i . - Satisfactory 

4 •■ Cood 

5 • Exenplary 



2.3 Student senices personnel 
consulted with teachers 
in classroom, management 
and early Identification 
of learner needs. 



1. EJementary school guidance counselor 
super\'ised the standardizeKiJsting 
program and interpreted test results 
to faculty. 

2. Student servirc personnel consulted 
with teachers and conducted in- 
servicf? OLavities concerning child 
growth and develcpment problems. 



0 - Can't Rato 

1 - Not Acceptable 
1 * Inadequate 

3 - Satisfactory 

4 * Good 

5 - Exemplary 



HEM mimm 
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SUPPORT SERVICES; 19M-1975 



District No, 



School No. 

bmd on the 



ITEM 



[mm 



2.4 Case cunferenct's (stall ui^) 
met the needs o[ f^cadents'. 



1. Case references with students, 
parents and staif were regular 
(i,e, appropriate to meet thv need 
of the indindual). 

2. Case conferences (staffing) were 
held at least once a month • 

3. ResponSibiUtles vere assigned 
fo Implement recowndationR. 



SCALP 



0 - Can't Rate 

1 • Not Accept It 

2 - Inadequate 

1 - Satisfactory 

i - Good 



2.5 Counielllng vi'h students by 
student services personnel 
was adequate and referrals 
were laade to commlty agencies 
where necessary. 



4. Reconnendations of case conferences I ^ " Exeiaplary 
were implemented. 



1. Logs were tept vhich documented 
that individual and/or snuU 

group counseling sessions are 
held dally. 

2. StiuVnt records Include notations 
of coiDfflUnlty or extra-school 
agencies that >-ave votked with 
referred students. 

3. Joint workshops .were* held with 
school and comnity personnel 
to assist in ^helr cooperative 
working. 

^. A directory of cownity serviCf's 
was kept. 



0 - Can't "ttt'' 
' Not Acc^Cu^. 

- Inadequate 

- Satlsfacto' v 
" Good 

- Exe",Dbry 



2.6 Tlie school student service 
program was effective in 
developing, conducting .ind 
participating in career 
awareness activities. 



1. Student service '-orkers partiripatLi^ 
with teachers in tlcveloplng career 
awareness learning activities. 

2. Product units__and/or materials 
to drKiiMent this are present, 



0 - Cap' I 'Lite 

1 - Not Acceptable 

2 - iiU.mto 

3 - ?3itlsf;':Lory 
- Good 

^ - Exemplary 



IIE^I EVALUATION 



* 



SUPPORT SERVICES: 1974-19/5 

District flo. School No. 

[/jyg ijcw profi'miml ;aijirr"!t, \iU the i|iwl:t;. oj .''hih itm observed in this sckoi ;rw "Hot kccf.d''.,-" i ') :.' ''Fsiv/ut/ (5' b:isdor, the 





:k(iU' m:U nr>/» Fleaee explain (inij itm u/itWi car.nol bi' witcd. 


m 


^ imm 


SC/llI 




].0 HEALTH SERVICES 

3. 1 Health screenlnti ^m- coaple^fd 
early enough in the scho'^l 
year so iht c.^.ch litwieia'B 
aeedd vcre trsn'id or cotaper- 
sated for. 
« 


1. Early identification syHteavaiJ 
organized and systcnuitlc. 

2, Documented results were present in 
student folders. 


0 - Can't Rate 

1 - Not Acceptable 

2 " Inadequate 

3 - Satisfactory 

4 - Good 

5 - Exemplary 




j«4 iiCuJlLii pci'jvuici l<. lau-lLCU 

contluuoualy vlth ^. .achers , 
In thi^ early identification 
of aucrltional or physical 
deficieai%J!8 afJcctlng 
learning perfor-ancfi, 


Ir Health histories for each student 
vere current, cooiplete and easily 
accessible to teachers. 


0 - Can't Rate 

1 - Not Acceptable 

2 - Inai'iquate 

3 - Sat.Jacto- 
k - Good 

5 - Exemplary 




3.3 ^v'jiWitlonn of physical and 
■ .Litional assessments 
weit reierrcd to parents 
or appropriate authorities 
for remediation. 


1. Rfiferrals/referencea were docmnent- 
ed In student records. 


0 - Can't Ratt; 

1 " Not Acceptable 

2 - Inndf^(jaate 

3 " Satlsf^iaory 
* Good 

5 - Exeir.plary 
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APPENDIX' ITT 



RESULTS OF THE OBSERVATIONS 



-65- 
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Al'I'l-NIUX Tll-l 



ITEM FREQUENCY AiNALYSIS 
MOST EFFICIENT/EFFECTIVE SCHOOLS 



^ .Survtv 

Item Number Uuscr Lpt ion ' 



5 


4 


3 


2 


1 


0 


NA 


M 


0 


lA 


9 




0 


0 


0 


0 


A 


9 


9 


3 


0 


0 


0 


0 


2 


10 


8 


5 


0 


0 


0 


0 


3 


10 


10 


2 


0 


0, 


0 


0 


0 


9 


12 


1 


0 


0 


0 


0 


5 


6 


12 


1 


0 


0 




0 


3 


10 " 


9 


2 


0 


0 




0 


5 


9 


8 


2 


0 


0 


I 


0 


1 


6 


10 


5 


1 


1 


I 


0 


5 


9 


9 


1 


0 


0 


I 


0 


2 


3 


7 


7 


2 


A 


0 


0 


5 


6 


12 


2 


0 


9- 


0 


0 


3 


7 


11 


2 


0 


0 


2 


0 


2 


7 


13 


1 


0 


0 


2 


0 


2 


9 


9 


0 


0 


3 


2 


0 


1 


8 


11 


2 


0 


1 


2 


0 


3 


11 


8 


2 


0 


0 


0 


1 


:3. 


12 


9 


0 


0 


0 


0 


1 


7 


12 


5 


0 


0 


1 


0 


0 


A 


16 


A 


1 


0 


0 


0 


0 


A 


16 


A 


1 


0 


0 


0 


0 


5 


15 


5 


0 


0 


0 


0 


0 


8 


12 


A 


0 


1 


0 


0 


0 


3 


11 


8 


2 


0 


1 


0 


0 




13 


7 


(J 


0 


0 


1 


0 


3 


3 


11 


■ 5 


2 


0 


0 . 


1 


2 


10 


10 


2 


0 


0 


0 


I 


2 


8 


13 


1 


.0 


0 


0 


1 


2 


12 


8 


1 


0 


0 


0 


1 


3 


7 


12 


2 


0 


0 


0 


X 


3 


10 


10 


1 


0 


0 


0 


1 


1 


6 


u 


5 


1 


0 


0 


L 



LURKICUI.UN 




1. I 




1.2 


Instr Prog 


1/3 


l>ingnoscd Ne"'ds 


1 


Red of Std Trog 


1 




l.h 


So If Conci'pts 


L-7 


Lrtik; Knviron 


1 .H 


V.ir i L»ty of M.it3 




MuU-Cult 


[.]'.) 


Honu'-Sch Cooanuii 


Ml 


iviront Educ 


\A?. 


K-J CoorU 




PRin;. t:VAL. 


1.1 


Pi .urn iiig 




N-N Pt-it Dar-a 


1.3 


f- R Tost Data 


1 


Nun-Achicv. Dati 


iTAFf l)hV£*:LOPMl NT 






1.2 


Apj>Lv Skills 






1 ; )■ 


kt*:.po[is ib i I i ty 


1.1' 




1. i 


I'lin i sbni'.-nl 


1 


i'ni icies 


!.:■> 


V 1 i [u: Ipal 




A.i qua!, v Kt;:-; 


1. / 


Ktcords 


:jUi'roi<r .';kkv 


i l!,S 


I.ii-rar',' ami MiaHa 


U ] ' 


. ; ;iui It Act i V 




A.^.'m;s 


1.3 


Input 




M. If .-rials 


1 . . 


IW'A i.i Ac I LV 


\.h 


A-V tqu i p 


K7 


Ti'L-h Assli.L 




t V i ces 


2/i " 


(.lour P'rogratr. 


2 . 2 


Rufrl & FLw-up 


2.3 


Cisrm Mgmt 


"I ' 


St .if f ing 




{iodnseling 


2 . f> 


Career Aware 


ilc'.iUh - St. 


r V L c e ^; 


3.r 


Sc r'.'on ing 



3.3 



Cons ult 
Piiv & Nutr Assess ' 



t 



10 
6 



7 
9 
11 



2 


8 


11 


1 


1 


0 


2 


0 


I 


12 


6 


3 


0 


1 


2 


0 


2 


5 


14 


. 3 


0 


0 


1 


0 


2 


9 


10 




1 


0 


1 


0 


1 


6 


12 


3 


1 


0 


1 


0 


1 


8 


7 


6 


0 


2 


1 


0 



N(vrKS: 



Wnid'i aiu! ai)hrfv i ,jr- i '.rn.s Hsced iindtT 'M fscr ipt i on"- and npposltr item numlu'r-; 
pi' >■•' i di' .i ••<•, ti' tlh' ::i)ntciU of it.,'m» Appendix M provldi's a i-mn;* 1 .'L f 

d • • s 1 • r i p r i I M 1 1 ^ r tM < • h i t • ' m . 



h 



iMt.j in . oUimn • (,pp,,-sit6' oa.-h item r«!p rest tit l he M'tal tuimhiT ol ralinK- of 
.IlIi I v;>,- h-: sr ,onl.s in fnr\\ ^:roti|t. 
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APPKNDIX 1 U-2 



itb:m frequkncy analyst'* 

U-'.AST EFFICIENT/EKFECl'IVr. SJhOOLS 



Frequen c y Coun t 



I) 



Survey 
Item Number 



NA M 



CURRICULUM 



1.1 


Cri)up ing 


0 


2 


17 


5 


0 


0 


0 


0 


1.2 


Instr Frog 


0 


2 






J 


0 


1 


0 


1.3 


Diagnosed NeeJs 


0 


4 


,.j 


10 


1 


u 


1 


0 


1.4 


Red of Std Frog 


0 


6 


^1 


10 


fj 


0 


0 


0 


1.5 


Balanced K-3 


1 


6 


12 


4 


I 


0 


0 


0 


1.6 


Self Concepts 


1 


10 


10 


2 


0 


0 


1 


0 


1.7 


Lrng Knvlron 


2 


9 


10 


3 


0 


0 


0 


0 


1.8 


Variety of Mats 


0 


1 


15 


7 


0 


0 


1 


0 


1.9 


Mult-Cult 


1 


2 


7 


10 


1 


2 


1 


0 


I.IO 


Mome-Sch Conuaun 


0 


14 


9 


1 


0 


0 


0 


0 


l.U 


Pa rcn t Educ 


0 


2 


0 


7 




7 


0 


0 


1. 12 


K- 3 Coord 


0 


2 


9 


12 


0 


0 


1 


0 


FL/\NNLNG ANU 


i'KOC. tVAL. 


















1.1 


P lann i ng 


0 


4 


12 




1 


1 


i 


0 


1.2 


N-K Test Data 


0 


6 


8 


7 


1 


I 


1 


0 


1.3 


C-H Test 'Jata 


n 


4 


11. 


5 




} 


•1 


0 


l.A 


Non-Ae'n iev. DaL.i 


0 


7 






0 


2 


1 


0 


STAFF DKVKLOi 




















1.1 


Met Needs 


0 


9 


11 


I 


0 


0 


0 




1.2 


Ape'ly Ski Us 


1 


7 


11 


2 


0 


0 


0 


J 


m.vn'a;l'm:ni 




















1.1 ' 


-puns lb i 1 i tv 


9 


8 


1 1 


■) 




0 


1 




1.2 


.i^Tt 


I 




7 


1 


i) 


0 


1 




1,3 


i' lii i slinu-nL 




12 


') 


1 


0 


0 


0 


f) 


1 


i'Mi.M.s ^^.-^ 


2 


8 


IJ 




0 


0 


0 




1.5 


1' r i nc i pa 1 


J 


8 


a 




I 


0 


<J 




1.6 


Atierjuate KeS 


3 


b 


f) 




1 


(3 


0 


1 


1.7 


Records 


0 


11 


11 


2 


0 


0 


0 




suproHi si-;kv!i:i.s 


















Library and Mfd i a 


















1. I 


S i mu 1 L Ac L i V 


1 


3 


10 


7 


(J 


U 


1 


0 


1.2 


A.cefis 


1 


3 


10 




0 


0 


1 


0 


1.3 


I nput 


0 


5 


16 




0 


'l 


0 


0 


J. 4 


Mal.eri als 


0 


7 


13 


4 


0 


0 


0 


0 


1.5 


M» d ia Al t iv 




7 


12 


3 


0 


1 


0 


0 


1.6 


A-V K(iu ip 




4 


13 


J 


u 


0 


-0 


0 


1.7 


Tech Assi.,t 




5 


7 


7 


3 


1 


1 


0 


SLudonr St 


rv ices 


















2.1 


Coor Program 


1 


3 


11 


8 


1 


n 


0 


0 


2.2 


itefrl I. Flw-up 


0 


3 


13 


6 


1. 


1 


0 


0 


2.3 


(Ms;rm M^'.mt 


0 


3 


9, 


11 


1 


0 


0 


0 


2.4 


Staf rinp, 


1 


3 


14 


4 




0 . 


1 


'0 


2.5 


\".>onse I in;; 


0 


4 


10 


10 


0 


0 


0 


0 


2.6 


Carcor Av^ar»' 


. 0 


4 


12 


7 


0 


0 


1 


0 


Ileal Lh Services 


















3.1 


Sc rem i 


0 


6 


}h 


2 


0 


0 


0 


0 


3.2 


Consu 1 1 


0 


6 


15 


2 


0 


0 


1 


0 


3.3 


i'hy 4i Nutr Asj;ess 


0 


3 


13 


4 


0 


0 


2 


0 






















NOTLS : 




















'Vords and 


nbl»reviat Ions I i j; 


ed under "de 


srr ipt Ign" 




nppo'. 




i I en 


nu 


provide a 


key to the )nt eiu el' t iie itLrni 


. App 


end ix 


1 ] 






a r(inipl 


dc'Ser i pr i 


ei. of each ' i icT,. 



















1 



Data in rwhimns opposite each Item represent the total number of rat inp,s; 
of v.fwh type by all schools in each ^roup. 



92 



-68- 

APPENDIX ITI-3 ■ 
ITEM MEAN SCORES 







Most 




Least 






Efficient /Effective 


Eff iclent/Ef fecciv" 






Schoo 


Is 


Schools 


Item Number 


Description^ 


Nb 


Mean 


N^ 


Mean 


CURRICULUM 












1.1 


Grouping 


25 


3.48 


24 


2.75 


1.2 


Instr Prog 


25 


3.56 


23 


2.48 


1.3 


Diagnosed Needs 


25 


3.36 


23 


2.65 


1.4 


Red of Std Prog 


25 


3.56 


24 


2 . 83 


1.5 


Balanced K-3 


25 


3.56 


24 


3.08 


1.6 


Self Concepts 


24 


3 .63 


23 


3.52 


1.7 


Lrng Environ 


24 


3.58 


24 


3.42 


1.8 


Variety of Mats 


24 


3.71 


23 


2.7^ 


1.9 


Mult-Cult 


23 


3.04 


21 


2.62 


I.IO 


Horae-Sch Commun 


24 


3.75 


24 


3.56 


l.U 


Parent Educ 


21 


2.81 


17 


2.47 


1.12 


K-3 Coord 


25 


3.56 


23 


2.57 


I'LANNLSC AND PROC. EVAL. 










1.1 


Planning 


23 


3.48 


22 


2.89 


1,2 


N-R Test Data 


23 


3.43 


22 


2.89 




C-R Test Data ■ 


20 


3.65 


20 


2.95 


1.4 


Non-Achiev. Data 


22 


3.36 


21 


3.09 


STAt'F DtVELDPMENT 






- 




1.1 


Met Needs 


24 


3.63 


21 


3.38 


1.2 


Apply Skills 


24 


3.75 


21 


3.33 


M.VNAGi-MKNT 












'i.i' 


Responi 'bj.lity 


24 


4.08 


23 


3.43 


1 


Rer.pect 


25 


3.92 


23 


3.65 


1.3 


Punishment 


25 


3.92 


24 


3.63 




PoIji:ies 


25 


4.00 


24 


3.42 


l.^j 


Principal 


25 


4.04 


24 


3.33 


1 


Adequate Res 


24 


3.63 


24 


3.21 


1.7 


Records 


24 


3.88 


24 


3.38 


SUPPORT SERVICES 










Library 


and Media 










l.T 


Slmult \ct:iv 


24 


3.00 


23 


3.0C 


1.2 


Access 


24 


3.50 


23 


3.28 


l.'l 


Input 


24 


3.46 


23 


3.15 




Materials 


. 24 


3.50 


24" 


3.15 


1.5 


Mofl ia Activ 


24 


3.46 


23 


3 .i2Q 


: .6 


A-V Equip 


24 


3.63 


24 


3.38 


1.7 


Tec^T Assist 


' 24 


3.04 


22 


2.64 


Student 


Serv i ces 










2.1 


Coor Program 


23 


S.39 


24 


2.79 


1.2 


Kefrl & Flw-up 


22 


3.50 


23 


2.78- 


2.3 


Clsrm Mgrat 


24 


3.04 


24 


2.60 


2 


Staffing' 


24 


3.38 


>!3 


2.98 


2.') 


Counseling 


24 


3.00 


24 


2.77 


2.6 


Career Aware 


22 


3.18 


23 


2.87 


i'ealth 


Services 










3.1 


.Screening 


23 


3.52 


24 


3.19 


3.2 


Consult 


22 


3.14 


23 


3.20 


3.3 


Phy & Nutr Assess 


21 


3.14 


22 


2.95 



NOTES: 

/ 



Avd ibbrevi.itions listed under "description" and opposite item numbers 
provide n k.,'y tr i ne con^.-^nt.of the Item. Appendix II provides a campleto 
de.^cr ipt ion of each item. 

^"N" denotes the number of scores jispd in deriving the mean score (r:iting; in 
each group. 
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APPENDIX III-/4 

ANALYSIS OF VARIANCF. 




si; \n 'ORT SEKVICK S 

UbraT)- and Media 



Sample Mean s 



Sample 
Size 



Population 
Variance 



Standard 
Error 



1 . 1 


Simult Activ 


3 


00 


3 


.00 


24 


123 


.97778 


.28853 




0 


1.2 


Access 


3 


50 


3 


.28 " 


24 


23 


.63207 


.23199 




.'.14832 


1.3 


Input 


3 


46 


3 


.15 


24 


23 


.4457: 


.19481 




.09 131 


1.4 


Materials 


3 


50 


3 


.15 


24 


24 


.48674 


,20140 


1 




1.5 


Media Activitici; 


3 


46 


3 


.28 


24 


i3 


.0:1115 


.2;3ib2 




7 7n4 7 


l.b 


A-V Equip ' 


3 


63 


3 


.38 


24 


24 


.72285 


.24544 


1 
1 


.01358 


1.7 


Tech Assistance 


3 


04 


2 


64 


24 


22 


.90r58 


.2G13S 


.42172 


Student 


Serv Ices 






















2.1 


Coord Program 


3 


39 


2 


79 


23 


24 


.78748 


.25894 


7 


31 714 


2.2 


Refrl & Flw-up 


3 


50 


2 


78 


22 


23 


.59100 


.22917 


3 


14177 


2.3 


Classroom Mgmt . 


3 


04 


2 


60 


24 


24 


.63910 


.23078 


1 


906 58 


2.4 


Staffing 


3 


38 


2 


98 


24 


23 


. 76877 


.25583 


1 


56 J 5 4 


2.5 - 


Counseling 


3 


00 


2 


77 


^ 24 


24 


.64151 


.23122 




99472 


2.6 


Career Awareness 




18 


2 


87 


22 


23- 


.64417 


.23935 


1 


29517 


Health 


Services 






















3.1 


Screen ing 


3. 


52 


3 


19 


23 


24- 


.64635 


.2345Q 


L 


406 71 


3.2 


Consult 


3. 


14 


3 


20 


• 22 


23 


.74212 


.25691 




2 3 3S4 


J. 3 


Phy !m Nutr Asuess 


3. 


14 


2 


93 


21 


22 


.59457 


.23525 




81 



NOTKS: 

''WofdH .-nut nhl)r«vlat Ions llyted und'T "dt-scr ipt iorj** and op;M»sUc item mimbe? • 
ihv it*m. Appi-ndlx II provides a complete description (»f '-ach item- 



Level of 
Significance 



Surv*-v 

ftt m Numhor 


a 

Dcscr Ipt Ion 






X 


2 ' 


1 


^0 
2 


S2 


S- ~ 

X - X 








CURRICULUM 



























1. 1 


Grouping 


3.48 


2 


.75 


25 


2': 


.36681 


.17306 


4 


.21817 


.0005 


1.2 


Instr Prog 


3 


.56 


2 


.48 


25' 


23 


.78042 


. 25525 


4 


.23115 


.0005 


1.3 


Diagnosed Needs 


3 


.36 


2 


.65 


25 


23 


.76038 ■ 


.25189 


? 


31869 


.005 


1,4 


Red of Std Prog 


3 


.56 


■ 2 


.83 


23 


24 


.67008 


.23392 


3 


.12073 


,005 


1.5 


Balanced K-3 


3'.56 


3 


.08 


25 


24 


■ .68071 


.23580 


3 


.09584 


.005 


1.6 


Strlf Concepts 


3 


63 


3.52 


\ 24 


23 


.65433 


.236^)3 




.46604 


1.7 


Lrng Environ 


3 


.58 


3 


.42 


\ 2^ 


24 


.68842 


.23950 




.66806 




1.8 


Variety of Mats 


3 


.71 


2 


.74 


\ 24 


23 


.59629 


.22535 


4 


.30441 


■ ,0005 


1.9 


Mult-Cult 


3 


04 


2 


.62 


^23 


21 


.85498 


.27907 


1 


.50500 


1.1.0 


Home-Sch Conanun 


3 


75 


3 


.56 


;24 


24 


.53188 


.21029 




.90351 




i.ll 


Parent Educ 




01 


2 


.47 


21 


17 


1.04093 


.33287 


1 


.02142 




1.12 


K-3 Coord 


3 


56 


2 


.57 


\ 


23 


.64810 


.23259 


4 


.25642 


.0005 


PLANNING AND 


PROG. EVAL. 










\ 














1.1 


■Plann Ing 


3 


43 


2 


89 


23 


22 


.64245 


.23902 




.44063 


.01 


1.2 


N-R Test Data 


3 


43 


2 


89 


23 


22 


.65718 


.24174 


2 


23J80 


. 111! 


1.3 


C-R Trst Data 


3 


6r> 


2 


.95 


20» 


20 


.46053 


.21462 


3 


26158 


.(,') ) 


1.4 


Non-Ach. i»jv. Data 


3 


3^ 


3 


09 


22\ 


21 


.55857 


.22801 


L 


.1841() 


..)S 


S I AKK UKVCLOPMErfJ" 










\ 














1 . 1 


Mt-r Ne ds 


3 


b3 


3 


38 


24 




. 52507 


.2U.52 


1 


1 'lA^j 




] .J 


Applv Skills 


3 


7b 


3 


33 


24 




,48129 


...2^/477 


> 
































'i.r' 


Respond Ibi] it>■ 


4. 


08 


3 


43 


24 


1 23 


^56636 


.21959 




200()fi 


.02 5 




Respect 


3 


92 


3 


65 


25 


1 23 


.45777 


.19547 


1 


3812') 




I . J 


Pun ishmunt 


3. 


92 


3 


63 


25 


1 24 


.49926 


.20192 


. 1 


43621 




J 


Po 1 tc i es 


4. 


00 


3 


42 


1 


24 


.50710 


.20350 


-) 


85012 


AH)') 


1.5 


Pr itici pal 


4. 


04 


3 


33 




24 


.98497 


.23362 


■» 


■30 334 


■.()] 




Adequate Res 


3. 


63 


3 


21 




24 


.89979 


.2 73.^3 


I 








Rfct^rds 


3. 


88 


3 


38 


24 


24 ■ 


^ .44024 


,1^132 




61070 . 


.01 



.0 3 



.02 s 

.00 5 

.OS 



provide .1 kt'V {; 



i t»nl . i)J • I 
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APPENDIX IV 



PING QUESTIONNAIRES 
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APPENDIX IV-1 



Questions 



1.1 Was the number of members on the 
team adequate for the task? 



1.2 Did you have sufficient expertise 
, in the area(s) that yoy evaluated? 



1.3 Do you feel that team members 
evaluating programs outside their 
field of expertise was. detrimental 
to the study? 



1.4 Did the training provided to yoii 
prepare you sufficiently enough ' 
to accomplish? 



Responses 

Pet. 

yes No yes* 



33 



38 



9 



24 



\ 



28 



12 



92 



91 



24 



67 



Reactions 



1 .1 921 agreed that the number of team 
members was adequate. 



1.2 911! agreed that their expertise 
was sufficient. 



1.3 24% of the respondents indicated 
that reviewing outside of their 
field to be detrimental. Interviews 
with team members indicated that it 
is more desirable to have personnel 
review in the area of their exper- 
tise. Perhaps additional criteria 
could be provided to assist those 
reviewing outside their area. 



1.4 67t of respondents felt that the 
training was sufficient for the time 
available. More time for training 
should be considered for future 
visiting teams. Public relations 
aspects could have been eirphasized 
more strongly as part jf the train- 
ing and before going out to schools. 
Meeting with fuculty was considered 
important as part of orientation. 
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(Juestions 


Responses 
yes No 


Pet. 
Yes 


Reactions 


1.5 Were you given adequate 
preparation in how to use the 
survey instrument? 


27 


10 


73 


1.5 73Uf the respondents, indicated 
that adequate preparation was pro- 
vided on how to use the survey 
instrument. Indicators used in the 
study should be part of the training. 
The validity of data -Should be 
understood. Some schools provided 
wrong data. 




I Visitation 


• 


2.1 Mas the visitation schedule 
realistic? 


33 


6 


85 


2.1 85X of the respondents indicated 
a realistic visitation schedule. 


2.2 Did the school staff have an 
adequate understanding of your 
mission? (ti '•eat level) 


28 


12 


70 


2.2 M of the team members responding 
indicated that the school staff had 
adequate understanding of the 
mission. It was suggested by some 
team members that a printed pamphlet 
be sent in advance to the schools 
being visited regarding the mission 
of the visit. Advance comnunications ■ 
to schools were not uniform. 

\ 


2.3 Were school personnel adequately 
prepared to, respond to your 
questions? 

93 


29 


8 


78 


2.3 781 of the team members responding 
expressed that the school personnel , 
were adequately prepared to respond 
to questions. Overall it was thought 
that personnel did a good job although 
not all prepared. . ■ ' 

99 
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Questions 


Responses 

Yes % 


Pet. 
Yes 


Reactions 


2.4 Did you have adequate access to 
all individuals needed to answer 
your questions (i.e. administrators, 
teachers, parents, students. etC;)?. 


41 


0 


100 


2.4 lOOX of the team. members responding 
to the instrument indicated that 
they had adequate access to all 

• individuals. 


2.5 Was the timing of the team visit 

appropriate fr^im the standpoint of 

tlie school? f.«. 
'\ 

, »• 


•37 
il 


i 


93 


2.5 931 pf the team members indicated 
that the timing of the visit was 
appropriate from the standpoint of 
tne school. 


2.6 In the future at what time of 
year would you recommend this study 
be conducted? 

~ " J" 1 








2.6 Responses were not provided for 
this question. 


2.7 Was the school staff helpful to 
you? 




u 


100 


2.7 100°/ of the team members indicated 
that the school staff was he'if^ftfl 
to them during the vi54^ 


2.8 Do you feel the environment of 
the school was supportive? 


37 ■ 


1 


97 


2.8 97^ of the team members responding 
indicated thct the environment of 
the school was supportive. 



100 



101 
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3. Survey tarn 



Questions Responses . Reactions 

Pet. 

yes No Yes 



3.1 Did the school status data provide 
useful information to you? 


34 


1 


83 


3.1 83X of the team members expressed 
that the school status data provided 
useful infonnation. 


AAii i| til t t 1* 

3.2 Were the written instructions on 
the survey instrument clear? 


14 


5 


87 


3.2 87X of respondents indicate that 
the written instructions on the 
survey instrument were clear. 


3.3 Were the item statements in most 
cases sufficiently self- 
explanatory? 


33 


6 


84 


3.3 845i of the team members responding 
.provided an affirmative answer to 
the question regarding the self- 
explanatory item statements. 


3.4 Mere the item statements too broad 
to rate effectively? 

1(12 


17 


23 


43 


3.4 43Uf the team members felt that 
the item statements were too broad 
to rate effectively. Some Indicated 
that evidence factors should be 
weighted. Some suggested that they 
be prioritized. Other personnel 
suggested that many of the evidence 
factors should be separated into 
item statements, Item statements 
did not consider planning being 
conducted outside the school (Where 
planninq takes place makes a differ- 
ence.) 103 
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(juestions 



3.5 Do you feel the nature and scope 
of the iteni statements provided were 

. adequate to evaluate key aspects- of 
the program? 



Responses 

Pet. 

Yes No Yes 



Reactions 



3.6 Did you identify any strong or weak 
■ aspects of the program area you 
evaluated which was not covered by 
the items stated? 
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N. 1 



25 



16 



61 



3.5 65^ of the respondents expressed 
that the nature and scope of the 
item statements provided were 
adequate to evaluate key aspects of 
the program. Rating the motivation 
factors needs to be addressed. 
Some criteria thought to be irrele- 
. vant. 



3.6 61 '» of the respondents expressed that 
... tlie evidence items were too broad. TTiey 
also felt that they should be put in 
priority order. There was a lack 
of equality of importance , in items. 
The items should be structured for 
equal importance. The items needed 
to be more specific. A weak point 
was that the evidence was used accord- • 
ing to the field of expertise in 
, which the person was know^ Jgeable. . 
' An area was needed to show the 
attitudinal feelings of the teacher 
and the school. They should reflect 
the affective aspect. Items which 
needed including in the evaluation 
were:. 

(1) how is discipline handled by 
administration . * 

(2) behavioral patterns of prin- 
cipal and faculty, and - 

(3) previous expK^jence taking 
the "bubble" wand/or specific 
reasons why situdents performed 
as they did on t^e test. 

A reconendation was made to distribute 
the items tO' district personnel ^ get 
them to identify evidence^* and let thenivr-., 
react to instrument. ^ '105 
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Questions 



3.7 'Do you feel that the evidence 
indicators were generally useful 
and comprehensive 'enough for 
evaluating the item? 



3.8 Did the team members use the 
evidence indicators in a, consist- 
ent manner? 



3.9' Was information generally available 
to document evidence iiio '-itors? 



ERIC 



Responses 

Pet. 

yes No Yes 



Reactions 



29 



28 



9 



78 



30 



90 



81 



3.7 78ro of the respondents felt that 
the evidence indicators were yenerally 
useful and comprehensive enough for , 
evaluating the item. It wes pointed 
out by several team member* that 
school personnel should have "other" 
opportunities to respond to the . 
structured evidence indicators. ' 
Some of the item statements drop(ied 
from original'design of item state- 
ments should be^ reinstated to staff 
development sectjon. 
Stress should be placed with team 
members the importance of secu^^ing ' 
input before visits are made. 
Evidehti: i'ndicators are essential for 
Ine interview process. 



3.8 M of the respondents expressed 
that the evidence indicators were 
used in a consistent manner. Only 31 
team members resfionded to this 
question. Ivj? 



3.9 81/S of the team members responding 
indicated that tf.o information 
available was generally available to 
document evidence indicators? A 
suggestion was made that information 
documents needed daring the visil 
should be requested wiien preliminary 
arrangetots are made with the school. 



(juestions • Responses Reactions 

Pet. 

yes No yes' 



1 

3.10 Were the rating scale levels 
adequately defined for you to 
identify qualitative differences? 


32 


6 


84 


3.10 84Uf the respondents stated 
that the rating scale levels were 
adequately defined to identify 
Qualitative differences 

/ 


3.11 Was the rating scale used adequate 
to evaluate the items? 


35 


4 


90' 


3.11 M of the team members indicated 
that the rating scale used was 
adequate to evaluate the items. 


3.12 In the next survey conducted would 
you favor maintaining this rating 
scale as is? 


24 


14 

i 


63 


3.12 63Uf those who responded appeared 
satisfied in maintaining the' current 
rating scale in the next survey 
conducted. It was pointed out that 
the original rating scales dropped 
from 10 to 7 to 5 criteria. Some 
members suggested dropping to three. ■ 
Although not completely happy with 
the current rating scale the consensus 
indicated keeping it at 5. Rating of 
zero needs to be clarified. 


3.13 Considering constraint in time 
and resources, was this the most 
appropriate way to assess quali- 
tative differences among schools? 

/ 

108 
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20 


8 


71 


3.13 711 of the team members responding 
indicated that contraints in time and 
resources that this was the most 
appropriate way to assess qualitative 
differences among schools. Only '28 
team members responded to the question. 
During the interviewing of team 
members about their responses to this 
survey, some expressed that all team 
members should oe trained to ask all 
questions. Better training of person- 
nel who go out to the schools should 
be programmed. 
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, • Questiops 



^. &(iT Interview 

Responses 

Pet. 

yes No Yes 



Reactions 



4.1 If an exit interview was conducted, 
was it constructive? 



4.2 Mould you recommend that such 
interviews be conducted on future 
visitations?., 



30 



31 



2 



10 



93. 
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4.1 93Uf those who responded 
expressed a constructive exit 
interview. 



4.2 M of the team members recommend 
that exit interviews be conducted 
on future visitations. Entrance 
interviews. appeared to be more 
significant than exit interviews. 
Some ejipressed that the. exit inter- 
view should consist of thafik you to 
the principa.!, that you enjoyed the ■ 
visit and no need for foniiei interview.. 
Some isolated Instances eApressed 
that the faculty should be assembled 
and the findings should be presented. 



5, IlHELINESS OF DATA 



. 5.1 Has the composition of the staff 
changed markedly since 1974-75? 



5.2 Did this cause problems in securing 
1974-75 data? 



20 



18 
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16 



20 



56 



47 



5.1 %i of the team members responding 
found that the composition of the staff 
changed markedly since 1974-75. 



I I 



5.2 47°i of those responding to this . 
question found problems securing 
1974-75 data. 

Turnover was definitely a factor 
in securing information. There 
• appeared 'to be a high correlation 
■ between the principal and what 
found. 



Ill 



TEAM CAPTAINS 



Questions 



1. As a team captain, do you feel that 
your concerns regarding the administra- 
tion of the survey were adequately 
addressed by the task force? 



Responses 

Pet. 

Y es No Yes 
1 2 78 



Conunents 



2. Were you given ajdequate.infonation 
to answer questions of your team 
members concerning the survey instru- 



10 ■ 0 100' 



I M of the team captains respding 
expressed that their concern regarding 
the administration of, the' survey was ■ 
adequately addressed by the task force. 
Most all team captains felt , the approach 
was new. The idea of 'Xile-playing usLig 
the instrument would make it more like 
the real situation. It was noted there 
was a significant difference, in the 
first and second visitationv' More\ 
attention should *be paid to iiisuring 
consistency in the instructions given. 
Sane people felt inadequate out of -their 
field and having to rely on others. 



I: 1001 of team captains expressed that 
they were given adequate infoimtion 
to answer questi{»is of team members. 



3. Were you provided adequate ijiformation 
tO' answer questions of school person- 
nel concerning the survey?' 



3. .881 of team captains expressed that 
they were given adequate information to 
answer questions of school per onnel. 



4. Were you provided enough infomation 
to satisfactorily answer your team's, 
questions concerning the visit? ■ 



10 'J 100 



4. 1001 of team captains expressed that 
they were provided enough information to 
answer team's questions concerning the 
visit, 
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Questions Res ponses Comments \ 

Pet. 

Yes No Yes 

5. Did the training l^rovided to you prepare 7 3 70 5. 70Uf team captains expressed that 
you sufficiently enough to accomplish ' training provided was sufficient enough 

your task? , fo^ their, to accomplish their task. 

CoiMinication given to team cuptaiiis 
was vague, according to the coiments. 
The guidelines given out should have been 
\ more specific. Listed below are examples 

• • of areas where guidelines needed to be 

, ■ . more specific: 

\ 

(1) contacting districts (when contact ' 
was to be made) ' ' 
V (2) meetings with faculty 

. (3) filling, out fom 

[4) how much current prograiii and 
prxesses should be locked at. 

Team captains felt some additional informa- 
tion about the school would have been 
' helpful. A great deal of ccncem was _ 

expressed about the schools not receiving 
' a copy of the instrument beforehand or 

getting anything after the visit. Some 
, schools were not knowledgeable about the * 

Cost-Effectivenes!?: Report (Part I). If 
' .the schools had known beforehand the type 

of infonation needed, the materials could 
have been available upon arrival. Most 
team members would have felt more ccmforta- 
ble if visiting in their m area of 
expertise. It was a consensus that it was 
difficult to get people together in order 
Hi to adequately prepare for visits. Ihe ] 
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captains felt if the same team had been 
together all the way that it would have 
been more helpful, 



9H!stlcii.s , Responses Comraents • 

Pet. ■ 
Yes No Yes 

6. Did the visitation report deadline alb^ 1 9 19 6. m of teaii captains felt timing was 
enough tune for adeqa^^te organization of adequate. , Captains felt tiling was 

,. difficult. It would have been helpful 

if the suiary'form coufi have been 
received before the vi&itatBns would 
have been beneficial. TTiiswuld give 
opportunity for de-briefing of team. 
It was felt that a longer time frame 
should have been allocated in which to 
make visits. 



7, Did the format of the report lend itself 
to an adequate presentation of what was 
actually taking place in the school? 



8. For the next survey, would you favor 
maintaining the report format as is? 



9 '0 100 



7 2 78 



7. 1001 of team captains felt that the 
foimat of the report did lend itself to 
an adequate presentation of what was 
, taking place in the school? 



8. M of team captains favored maintaining 
report format as is? ■ 



9. Did the report provide enough data to 
present an in-depth picture of the 
school-its composition and processes? 



o 1 
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9. 60^0 of team captains expressed that 
report provided enough data. A lot of^ 
the School Status Data was inaccurate and 
a great deal of inconsistency was found 
by team captains. " The source of the 
infoimation on the iorm was needed. The 
fom needed a category entitled "signifi- 
cant criteria"^ Items which were identified 
by team captains which uuld be j.n this 
category were: ■ (1) faculty turn over, 

(2) emphasis on teaching of the test, and 

(3) hunanistic attitudes. In some 
instances, there was not enough room on 
the fonn. Some data collected was objec- 
tive while also subjective. /The question 
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Question s 



Responses 



Comnients 



Vcs \'o 



Pet. 

Yes 



was asked if it were possible to include 
' information of the form about what is ' 
going on now in the schools as compared 
to earlier yc;ars. Hiere seemed to be a 
consensus that this whole question needed 
to be reviewed and reworked. 
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